Information and communication technology (ICT) increasingly is utilised in second-level English education, aiming to engage students, yet quantitative instruments for evaluating the impact of technology-mediated learning experiences are lacking. This article presents the rationale, development and psychometric analysis of the English and Technology Attitudes Scale (ETAS): a 19-item instrument designed to evaluate students' attitudes towards English and technology and monitor changes. Five constructs are measured: behavioural engagement; technology confidence; English confidence; emotional engagement; and learning with technology. Using the ETAS, this study revealed insights to Irish students' (n = 419) attitudes that can inform approaches to teaching and learning with ICT. Despite strong technology confidence, a high proportion of students report poor attitudes towards learning English with technology. Moreover, males have significantly more positive attitudes towards learning English with technology, yet females have significantly higher engagement in English. These findings demonstrate both the need for and the usefulness of this instrument.