This study and analysis are designed to find a common, practical measurement tool that may be used for intra- and interprogram evaluation of Japanese programs, especially in the higher education context. First, three previous methods of evaluation (the Oral Proficiency Interview, the Nihongo Noryoku Shiken or Japanese Language Proficiency Test, and the Simple Performance-Oriented Test) are analyzed for strengths and weaknesses as common, practical measurement tools. The Japanese Skills Test (JSKIT) is suggested as superior to these three, especially in distinguishing first- and second-year ability in the language. The JSKIT is evaluated on the basis of being both valid and reliable as a test. This is supported by data collected at a nine-week summer intensive language program during the summers of 2000 and 2001, at entry and exit points. (Contains 9 notes, 7 tables and 3 figures.)