ERIC Number: EJ930978
Record Type: Journal
Publication Date: 2011-Jul
Pages: 5
Abstractor: As Provided
Reference Count: 24
ISBN: N/A
ISSN: ISSN-0278-7393
Clarifying the Advantage of Small Samples: As It Relates to Statistical Wisdom and Cahan's (2010) Normative Intuitions
Fiedler, Klaus; Kareev, Yaakov
Journal of Experimental Psychology: Learning, Memory, and Cognition, v37 n4 p1039-1043 Jul 2011
On the basis of earlier findings, we (Fiedler & Kareev, 2006) presented a statistical decision model that explains the conditions under which small samples of information about choice alternatives inform more correct choices than large samples. Such a small-sample advantage (SSA) is predicted for choices, not estimations. It is contingent on high constant decision thresholds. The model was harshly criticized by Cahan (2010), who argued that the SSA disappears when the threshold decreases with increasing sample size and when the costs of incorrect decisions are higher than the benefits of correct decisions. We refute Cahan's critique, which confuses normative and descriptive arguments. He neither questioned our theoretical reasoning nor presented empirical counterevidence. Instead, he discarded our model as statistically invalid because the threshold does not decrease with increasing sample size. Contrary to this normative intuition, which presupposes a significance-testing rationale, we point out that decisions are often insensitive to sample size. We also refute Cahan's intuition that ignoring the potential asymmetry of gains and losses creates a serious bias in favor of the SSA. We regret any misunderstandings resulting from our linking the SSA to Bernoulli's law of large numbers. (Contains 1 figure and 2 footnotes.)
Descriptors: Sample Size, Information Theory, Prediction, Selection, Computation, Models, Intuition, Academic Discourse, Bias
American Psychological Association. Journals Department, 750 First Street NE, Washington, DC 20002-4242. Tel: 800-374-2721; Tel: 202-336-5510; Fax: 202-336-5502; e-mail: order@apa.org; Web site: http://www.apa.org/publications
Publication Type: Journal Articles; Opinion Papers; Reports - Descriptive
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers: N/A

Peer reviewed
Direct link
