In education research, statistical significance and effect size are 2 sides of 1 coin; they complement each other but they do not substitute for each other. This descriptive study, however, was limited to effect size only because years of experience with Idaho statewide student samples of up to 24,000 the rare outcomes has been t-tests with…

Idaho uses the English Language Arts and Mathematics tests from the Smarter Balanced Assessment Consortium (SBAC) for the Idaho Standard Achievement Tests. ISAT results have been reported almost exclusively as "percent proficient or above" statistics (i.e., the percentage of Idaho students who performed at the "A" level). This…

Idaho uses the English Language Arts and Mathematics tests from the Smarter Balanced Assessment Consortium (SBAC) for the Idaho Standard Achievement Tests (ISAT). ISAT results have been have been reported almost exclusively as "percent proficient" statistics (i.e., the percentage of Idaho students who performed at the "A" level…

Public school critics often point to rising expenditures and relatively flat test scores to justify their school reform agendas. The claims are flawed because their analyses fail to account for the difference in data types between dollars (ratio) and test scores (interval). A cost-benefit analysis using dollars as a common metric for both costs…

The National Center of Education Statistics conducted a mapping study that equated the percentage proficient or above on each state's NCLB reading and mathematics tests in grades 4 and 8 to the NAEP scale. Each "NAEP equivalent score" was labeled according to NAEP's achievement levels and used to compare state proficiency standards and…

Test developers are responsible to define how test scores should be interpreted and used. The No Child Left Behind Act of 2001 (NCLB) directed the Secretary of Education to use results from the National Assessment of Educational Progress (NAEP) to confirm the proficiency scores from state developed tests. There are two sets of federal definitions…

The U.S. Department of Education has not yet published an official guidance document for using NAEP achievement level scores to confirm state testing results. A review of the literature, however, identified four principles that inform the valid use of NAEP scores in a confirming analysis. The principles address the appropriate NAEP statistics to…

The No Child Left Behind Act sanctions the use of NAEP scores to confirm state testing results. The U.S. Department of Education, as test developer, is responsible to set forth how NAEP scores are to be interpreted and used. Thus far, the Department has not published a clear set of guidelines for using NAEP achievement level scores to conduct a…

The No Child Left Behind Act (NCLB) permits the Secretary of Education to use NAEP achievement level scores, in concert with other data, to confirm state testing results. The U.S. Department of Education has not yet published a guidance document describing how NAEP might be used appropriately. A review of the literature from the Department and…

This paper discusses a Standard & Poor's analysis of state performance on the 2005 and 2003 NAEP reading and mathematics tests that took account of the demographic differences among the states. The study was presented at the NAEP State Service Center Winter Workshop in January, 2006. Standard & Poor's is commended for recognizing that NAEP…

Results from the National Assessment of Educational Progress (NAEP) and other large scale tests are often reported as rank ordered lists showing mean values for each of the 50 states. Using data from the 2003 State NAEP Assessment, this paper examines the standard errors associated with State NAEP scores and explains why the use of rank order…

Under the leadership of the Language Arts Curriculum Committee, the Greater Albany (Oregon) Public Schools conducted its second annual district assessment of writing skills of students in grades 5, 7, 9, and 11, using the "analytic trait scoring" method (ATS). The testing procedure, diagnostic in purpose, conformed to the writing process…

The Music Curriculum Steering Committee of the Greater Albany (Oregon) Public School District 8J developed its own tests and evaluation procedures to accumulate data on music achievement and performance levels from students in third, fifth, eighth, and eleventh grades. Tests for third and fifth grade students focused on musical notation, listening…

Under the leadership of the Language Arts Curriculum Committee, the Greater Albany (Oregon) Public Schools conducted a district assessment of writing skills of students in grades 5, 7, 9, and 11, using the "analytic trait scoring" method (ATS). The testing procedure conformed to the writing process implemented through the district's Real…

This report presents the findings of an evaluation conducted in the Greater Albany Public School System 8J (Oregon) to determine the effects of computer assisted instruction (CAI) in mathematics as delivered by the WICAT System 300 at the Periwinkle Elementary School. Evaluation activities were designed and conducted to determine whether the…