The purpose of this study was to identify and validate items applicable to evaluating online courses at the postsecondary level. Items were derived from a review of the literature. Four judges rated the similarity of the items by making pair-wise comparisons utilizing multidimensional scaling (MDS). The study consisted of five stages. Stage I involved identifying items. Stage II involved validating items. Stage III involved sampling. Stage IV involved developing an online MDS instrument accommodating the 4,851 ([99 * 98]/2) pair-wise comparisons and rating them. Stage V involved data collection and analysis. The results of the MDS study indicated a three-dimensional solution (Accessibility, Adaptability, and Clarity of Communication) as the appropriate model for analysis. The three-dimensional solution indicated 0.24222 for the fit values of STRESS and 0.74 for R-squared. Four clusters were identified as Contextual Accommodation, Instructional Access, Guided Learning, and Organizational Clarity.