Drawing on a sociocultural perspective on educational assessment the empirical examples of Margareta Serder and Anders Jakobsson serve as a starting point for a critical analysis of PISA and the image of science education it perpetuates. While PISA claims to neutrally measure competencies relevant to science education, I argue that the test questions enact a very narrow definition of science and fail to account for the social context of testing.