NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
PDF on ERIC Download full text
ERIC Number: EJ852315
Record Type: Journal
Publication Date: 2004-Jul-20
Pages: 46
Abstractor: As Provided
Reference Count: 58
ISSN: ISSN-1068-2341
Reasonable Decisions in Portfolio Assessment: Evaluating Complex Evidence of Teaching
Schutz, Aaron; Moss, Pamela A.
Education Policy Analysis Archives, v12 n33 Jul 2004
A central dilemma of portfolio assessment is that as the richness of the data available to readers increases, so do the challenges involved in ensuring acceptable reliability among readers. Drawing on empirical and theoretical work in discourse analysis, ethnomethodology, and other fields, we argue that this dilemma results, in part, from the fact that readers cannot avoid forming the data of a portfolio into a pattern--a coherent "story" or "stories"--in order to evaluate it. Our article presents case studies of readers independently evaluating the same portfolios. We show that even readers who hold a shared vision of effective teaching and who cite much the same evidence can, nonetheless, develop significantly different "stories." Our analysis illustrates that some portfolios are more ambiguous than others and are thus more likely to result in such divergent readings. We argue that more fine grained understandings of portfolio ambiguities and disagreements between readers over "stories" can help us respond to the challenges posed by the rich data of portfolio assessments. (Contains 2 figures and 15 notes.)
Colleges of Education at Arizona State University and the University of South Florida. c/o Editor, USF EDU162, 4202 East Fowler Avenue, Tampa, FL 33620-5650. Tel: 813-974-3400; Fax: 813-974-3826; Web site:
Publication Type: Journal Articles; Reports - Evaluative
Education Level: Adult Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A