ERIC Number: ED400333
Record Type: Non-Journal
Publication Date: 1996-Feb
Reference Count: N/A
The Reliability of Document-Based Essay Questions on Advanced Placement History Examinations.
Bridgeman, Brent; And Others
If a student writes two essays, the score reliability can be estimated from the correlation between essays. However, if the essays are in different modes or require different skills, the reliability may be underestimated from the correlation. In Advanced Placement history examinations, students wrote one standard essay and one essay that required analysis and synthesis of historical documents that were included with the question statement. If these Document-Based Questions (DBQs) were assessing substantially different skills from the standard essays, then the reliability of DBQ scores would be underestimated from their correlation with a standard essay score. A sample of 1,045 U.S. history students and 891 European history students participated in a special study in which they wrote essays for either 2 DBQ questions and 1 standard essay question or 3 standard essay questions. The DBQ correlated as highly with a standard essay as with another DBQ, suggesting that the simple correlation of the two types of scores did not underestimate the reliability of the essay scores. Appendix A lists standard essay topics, and Appendix B presents DBQ topics. (Author/SLD)
Publication Type: Reports - Research
Education Level: N/A
Authoring Institution: Educational Testing Service, Princeton, NJ.
Identifiers - Assessments and Surveys: Advanced Placement Examinations (CEEB)