ERIC Number: ED191874
Record Type: RIE
Publication Date: 1979
Reference Count: 0
A Numerical Scoring Method for Summaries in Prose Learning Research.
Christopherson, Steven L.
A procedure for creating a numerical index which can be used to score and rank summaries of prose passages is described. The quality of a summary is assumed to be a function of two variables: the number of important ideas mentioned, and the number of words used. Scoring involves multiplying two ratios: a power ratio and an efficiency ratio. The product is consistent with the assumption that better summaries are those which include more of the important ideas while using fewer words. Reliability was checked by rescoring all summaries after six months; the reliability of the index across that period was .86. Criterion-related validity was estimated by correlating the scores with subjective judgments made by the six undergraduate judges as to which summaries were better. Construct validity was checked by an experimental procedure which was expected to affect the quality of summaries. The results are promising, and the scoring procedure appears to have good reliability and validity; its value, however, needs to be tested by others. (Author/GK)
Publication Type: Speeches/Meeting Papers; Reports - Research
Education Level: N/A
Authoring Institution: N/A
Identifiers: Efficiency Ratio; Power Ratio
Note: Paper presented at the Annual Meeting of the Eastern Educational Research Association (Kiawah Island, SC, February 20-24, 1979).