There are very few examples of audio-based computerized tests, but for many disciplines, such as foreign language and music, there appear to be many benefits to this type of testing. The purpose of the present study was to develop and compare computer-delivered and audiocassette/paper-and-pencil versions of a listening test. The test was a measure of progress achievement of academic listening comprehension and vocabulary for high-intermediate level students of English as a Second Language (ESL) at a university-affiliated institute. The underlying assumption investigated was that the use of computer and audio technology for classroom progress tests would provide benefits of convenience and improved sound quality while providing measurement quality and validity that were at least comparable to the paper form of such tests. Results with 28 students indicate that the computerized test performed at least as well as the paper-and-pencil version, with generally comparable validity. Appendixes contain the paper-and-pencil test and a list of the student survey questions. (Contains 4 figures, 11 references, and 7 additional resources.) (SLD)