A 14-item, multiple-choice diagnostic assessment tool, the quantum chemistry concept inventory or QCCI, is presented. Items were developed based on published student misconceptions and content coverage and then piloted and used in advanced physical chemistry undergraduate courses. In addition to the instrument itself, data from both a pretest,…

The American Chemical Society Examinations Institute (ACS-EI) has recently developed the Exams Data Analysis Spread (EDAS) as a tool to help instructors conduct customizable analyses of their student data from ACS exams. The EDAS calculations allow instructors to analyze their students' performances both at the total score and individual item…

Two different versions of "big ideas" rooted content maps have recently been published for general chemistry. As embodied in the content outline from the College Board, one of these maps is designed to guide curriculum development and testing for advanced placement (AP) chemistry. The Anchoring Concepts Content Map for general chemistry…

As a way to assist chemistry departments with programmatic assessment of undergraduate chemistry curricula, the ACS Examinations Institute is devising a map of the content taught throughout the undergraduate curriculum. The structure of the map is hierarchal, with large grain size at the top and more content detail as one moves "down"…

With the increasing emphasis placed upon chemistry instructors and departments to assess and evaluate their courses and curricula, understanding the structure of chemistry faculty members' knowledge and use of assessment terms and concepts can shed light on potential areas for targeted professional development. Survey research that might…

As is true for virtually all of higher education, chemistry departments are often required to provide evidence of student learning at both course and curricular levels through evaluation and assessment. The ACS Exams Institute conducted a needs assessment survey of 1500 chemistry faculty members from across the country to investigate motivation,…

The ability to coherently assess content knowledge throughout an entire undergraduate career represents a significant advantage for programmatic assessment strategies. Chemistry, as a discipline, has an unusual tool in this regard because of the nationally standardized exams from the ACS Exams Institute. These exams are norm-referenced and allow…

To provide tools for programmatic assessment related to the use of ACS Exams in undergraduate chemistry courses, the ACS Exams Institute has built a content map that applies to the entire undergraduate curriculum. At the top two levels, the grain size of the content classification is large and spans the entire undergraduate curriculum. At the…

The design and use of a valid and reliable instrument for the assignment of cognitive complexity ratings to chemistry exam items is described in this paper. Use of such an instrument provides a simple method to quantify the cognitive demands of chemistry exam items. Instrument validity was established in two different ways: statistically…

In 2005, the ACS Examinations Institute released an exam for first-term general chemistry in which items are intentionally paired with one conceptual and one traditional item. A second-term, paired-questions exam was released in 2007. This paper presents an empirical study of student performances on these two exams based on national samples of…