NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ953397
Record Type: Journal
Publication Date: 2012
Pages: 26
Abstractor: As Provided
Reference Count: 40
ISSN: ISSN-0895-7347
A Substantive Process Analysis of Responses to Items from the Multistate Bar Examination
Bonner, Sarah M.; D'Agostino, Jerome V.
Applied Measurement in Education, v25 n1 p1-26 2012
We investigated examinees' cognitive processes while they solved selected items from the Multistate Bar Exam (MBE), a high-stakes professional certification examination. We focused on ascertaining those mental processes most frequently used by examinees, and the most common types of errors in their thinking. We compared the relationships between different problem-solving processes, errors, and performance, and assessed the degree to which performance was related to correspondence between examinees' and model problem-solving approaches. Participants most commonly solved problems with reference to legal principles and cues presented in problem stems, but also resorted to other mental processes. We found that performance on the MBE is strongly related to domain-specific skill in using legal principles, as well as to domain-general metacognitive skill in organizing thinking. Evidence that would suggest that testwiseness strategies or common-sense reasoning was a source of construct-irrelevant variance on the MBE was not found. Our study demonstrated a systematic method for in-depth analysis of examinee substantive processes on examinations such as the MBE that assess complex reasoning within a specific domain. (Contains 1 figure and 5 tables.)
Routledge. Available from: Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Arizona