This article considers whether reading on screen is the same as reading on paper, and specifically whether reading comprehension is the same in both media. After reviewing relevant research, the article describes and reports the results of an NZCER research project that compared data records from online and paper-based versions of PAT: Reading Comprehension. It concludes by discussing the implications for classroom practice and for assessment of reading comprehension in an increasingly digital world.