Although it has long been acknowledged that interviewers play a crucial role in the survey data collection process, there is little research concerning interviewer effects on how respondents perceive the interview. We investigate whether interviewer effects exist regarding how much respondents report having enjoyed the interview and whether these…

Previous work has demonstrated similarities and differences between aerial and terrestrial image viewing. Aerial scene categorization, a pivotal visual processing task for gathering geoinformation, heavily depends on rotation-invariant information. Aerial image-centered research has revealed effects of low-level features on performance of various…

I propose two practical advances to the argument-based approach to validity: developing a living document and incorporating preregistration. First, I present a potential structure for the living document that includes an up-to-date summary of the validity argument. As the validation process may span across multiple studies, the living document…

Monitoring the fidelity with which implementers implement behavioral procedures is important, but individuals tasked with monitoring fidelity may have received little training. As a result, their data may be affected by variations in implementers' performance, such as the frequency of fidelity errors. To determine the extent to which the frequency…

Estimating prescription medicine use is challenging due to recall bias associated with surveys and coverage bias in administrative data. This study assesses how making operational improvements and combining both survey and administrative data sources can increase data quality on filled prescriptions. We use data from the Medicare Current…

Big Data offers opportunities and challenges in all aspects of human life. In relation to research ethics, Big Data represents a normative difference in degree rather than a difference in kind. Data are more messy, rapid, difficult to predict, and difficult to identify owners; but the principles of informed consent, confidentiality, and prevention…

Higher education is awash with data that, when refined, facilitates data-informed decisions. Such decision-making is much more prevalent in support of undergraduate education given the much larger number of undergraduates pursuing higher education in contrast to the much smaller proportion of graduate students. A simple extension of current…

During the COVID-19 pandemic, organizations increased virtual programming and adoption of online technologies. This article outlines the University of California assessment of tools for gathering data on participant learning outcomes from virtual educational programs. After assessing colleagues' experiences and searching for new web applications,…

The five SEERNet digital learning platforms (DLPs) present unique opportunities for researchers by offering tools, processes, and infrastructure to make research more efficient, scalable, and relevant. However, conducting research within a DLP may require a shift in a researcher's orientation or mindset in how they think about potential research…

This paper considers how effectively inspection takes account of the 'lived experience' of young people in school and in their leisure time, and identifies some weaknesses in both data gathering and reporting. It asserts that Ofsted should be more forthright in its judgments of the curriculum range now offered in schools, and regrets its lack of…

Data extraction is a time-consuming and resource-intensive task in the systematic review process. Natural language processing (NLP) artificial intelligence (AI) techniques have the potential to automate data extraction saving time and resources, accelerating the review process, and enhancing the quality and reliability of extracted data. In this…

There is a growing need to empirically evaluate the quality of online instructional interventions at scale. In response, some online learning platforms have begun to implement rapid A/B testing of instructional interventions. In these scenarios, students participate in series of randomized experiments that evaluate problem-level interventions in…

The method of web probing integrates cognitive interviewing techniques into web surveys and is increasingly used to evaluate survey questions. In a usual web probing scenario, probes are administered immediately after the question to be tested (concurrent probing), typically as open-ended questions. A second possibility of administering probes is…

In teacher education, there is a growing need for teachers to become data literate by collecting a variety of data on student learning to assess student progress and inform instruction. Research on pedagogical documentation in education, in particular early childhood education, has been undertaken to make students' learning visible by documenting…

The number of meta-analyses of aggregate data has dramatically increased due to the facility of obtaining data from publications and the development of free, easy-to-use, and specialised statistical software. Even when meta-analyses include the same studies, their results may vary owing to different methodological choices. Assessment of the…