U.S. universities and colleges offering distance education courses have increased immensely since 1998, and by 2004 it was expected that distance learners will constitute about 14% of all those enrolled in degree programs. In its preliminary review of distance learning, the Institute for Higher Education Policy (1998) emphasized the need for reliable and valid performance measurements and while individual course evaluations have always been applied, no overall assessment of the distance learning program at University of Medicine and Dentistry of New Jersey (UMDNJ) School of Health-Related Professions (SHRP) School's had ever taken place, nor was there a strategy to do so. To that end, a Technology Task Force (TTF) was created and charged with evaluating the School's overall distance learning program. This paper presents the findings and the immensely practical value found by the UMDNJ School of Health-Related Professions Technology Task Force in using scale data in its the quality improvement efforts. It is recommended that this tool be incorporated or adapted by colleges and universities as one of the means used to assess the quality of their Internet-based distance learning efforts.