NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
PDF on ERIC Download full text
ERIC Number: EJ1334914
Record Type: Journal
Publication Date: 2022-Feb
Pages: 14
Abstractor: As Provided
ISBN: N/A
ISSN: EISSN-1531-7714
EISSN: N/A
Gauging Teaching Performance: Observational Sampling Opportunity, Reliability, and the Manifestation of True-Response Data
Howard, Jeffrey N.
Practical Assessment, Research & Evaluation, v27 Article 1 Feb 2022
The Student Evaluation of Teaching (SET) instrument provides insight for instructors and administrators alike, often touting high response-rates to endorse their validity and reliability. However, response-rate alone omits consideration for "adequate quantity of 'observational sampling opportunity' (OSO) data points" (e.g., high student attendance). The current paper endorses that quantity of OSO data points is critical to validity/reliability of longitudinal SET paradigms. It is reasoned ethically-challenged to rely on SET via basic surface-measures such as simple 'response-rate', when specific higher-quality data reflecting adequate quantity of OSO data points, can be filtered for from the same dataset. In addition, ethical concerns regarding the gauging of teaching performance via quantitative data analyses applied to inappropriate categorical/nominal response data, is also discussed.
Center for Educational Assessment. 813 North Pleasant Street, Amherst, MA 01002. e-mail: pare@umass.edu; Tel: 413-577-2180; Web site: https://scholarworks.umass.edu/pare
Publication Type: Journal Articles; Reports - Descriptive
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A