This study investigated the extent of agreement between MicroPROUST, a prototype microcomputer-based expert scoring system, and human readers for two Advanced Placement Computer Science free-response items. To assess agreement, a balanced incomplete block design was used with 2 groups of 4 readers grading 43 student solutions to the first problem…

A case is presented for adjusting the scores for free response items in the Advanced Placement (AP) tests. Using information about the rating process from the reliability studies, administrations of the AP test for three subject areas, psychology, computer science, and English language and composition, are analyzed. In the reliability studies, 299…

The increasing use of microcomputers and hand-held calculators has implications for mathematics and science instruction, achievement testing, and educational research. The potential effects of these technologies on curricula involve both content and delivery. In mathematics instruction, the focus may shift from manipulative to higher order skills.…

The relationship between the multiple-choice and free-response sections of the Computer Science and Chemistry tests of the College Board's Advanced Placement program was studied. Confirmatory factor analysis showed that the free-response sections measure the same underlying proficiency as the multiple-choice sections for the most part. However,…

This study examined the relationship of a machine-scorable, constrained free-response computer science item that required the student to debug a faulty program to two other types of items: multiple-choice and free-response requiring production of a computer program. The free-response items were from the College Board's Advanced Placement Computer…

The major objectives and benefits of the Advanced Placement Program (APP) are summarized, and data specific to Delaware are compared to national statistics about advanced placement (AP) courses in high schools. School participation in the APP is considered an indicator of academic success by educators and policy makers. The extent to which…

The use of constructed response items in large scale standardized testing has been hampered by the costs and difficulties associated with obtaining reliable scores. The advent of expert systems may signal the eventual removal of this impediment. This study investigated the accuracy with which expert systems could score a new, non-multiple choice…

In a follow-up to findings published by H. Stumpf and J. Stanley (1996), the gender-related differences in enrollment in and scores on the College Board Achievement (SAT II) and Advanced Placement (AP) tests were studied. Differences in scores turned out to be rather stable from 1982 (for the Achievement tests) and 1984 (for the AP tests) through…

This study compared performance of seniors at 21 Montgomery County (Maryland) high schools on the Advanced Placement (AP) Tests. The schools were ranked by the percentage of college-educated adults within the school boundaries, and the ranking was compared to Advanced Placement test results (the average number of students, per 100 seniors, who…

This study examined the relationship of multiple-choice and free-response items contained on the College Board's Advanced Placement Computer Science (APCS) examination. Subjects were two samples of 1,000 randomly drawn from the population of 7,372 high school students taking the 1988 examination of the APCS "AB" form. Most were high…