Although previous studies have identified various influences on course website effectiveness, the evaluation of the relative importance of these factors across different online learning experience groups has not been empirically determined. This study develops an evolution model that integrates triangular fuzzy numbers and analytic hierarchy process to develop a fuzzy evaluation model which prioritized the relative weights of course website quality factors. Firstly, this study conducts a review of the literature on course website quality to generate 16 sub-criteria along with four criteria used to measure course website quality. Secondly, a fuzzy AHP approach is adopted to determine the relative weights linking the above criteria between high and low online learning experience groups. The results indicated that there are some similarities and differences between high- and low-experience groups with regard to the evaluation of course website quality. The evaluation model and results can provide a valuable reference for system designers seeking to enhance course website effectiveness. (Contains 7 tables and 1 figure.)