ERIC Number: EJ1256794
Record Type: Journal
Publication Date: 2020
Pages: 13
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1743-727X
EISSN: N/A
Do We Always Need a Difference? Testing Equivalence in a Blended Learning Setting
Mueller, Claude; Mildenberger, Thoralf; Lübcke, Maren
International Journal of Research & Method in Education, v43 n3 p283-295 2020
Evidence-based research is becoming increasingly important in educational research. Calculation and test methods available in statistical software packages such as SPSS and STATA are widely used. To evaluate teaching innovations such as blended learning against classical classroom settings, for example, previous studies have mainly applied inference methods such as the t-test or variance analyses. The problem with these methods is that they test for the difference. A non-significant result does not automatically mean equivalence of the treatments examined, which is why we propose the use of equivalence testing. This paper introduces the equivalence test as complementary to the classical t-test and briefly discusses other approaches based on confidence intervals and Bayesian methods. As an example, the introduction of a blended learning format to a Bachelor's degree programme is used to demonstrate the procedure and discuss the results of conducting an equivalence test. By combining tests for difference and equivalence successfully, it was possible to arrive at more informative statistical statements: Whereas a t-test alone only produced results for three out of 22 courses, a t-test and an equivalence test in combination yielded statistically confirmed statements for 12 out of 22 courses.
Descriptors: Blended Learning, Instructional Effectiveness, Equivalency Tests, Conventional Instruction, Statistical Analysis, Grades (Scholastic)
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A