A partnership was created between psychologists and computer programmers to develop a computer-based assessment program. Psychometric concerns of accessibility, reliability, and validity were juxtaposed with core development concepts of usability and user-centric design. Phases of development were iterative, with evaluation phases alternating with development phases. The system was evaluated by the team using an accessibility measure, standard usability heuristics, and student questionnaires (n = 131). In its final form, the assessment was satisfactory to students, although many students did not use the provided testing accommodations, and reliability analyses were in the acceptable range. Recommendations include updating and creating common language, standards, heuristics, and measures to develop and evaluate computer-based assessments.