Currently, e-learning systems are being widely used in all stages of education. However, it is difficult for school administrators to accurately assess the actual usage performance of a new system, especially when an organization wishes to update the system for users from different backgrounds using new devices such as smartphones. To allow school administrators to conduct upgrades of e-learning systems that take into consideration students' current usage conditions, this study proposed a two-stage system evaluation approach to explore the adoption of new systems. We collected 352 samples in Stage I. The goal of this Stage I was to propose a research model to understand the usage intentions of college students toward campus e-learning systems and also the factors which showed significant differences between PC and smartphone usage. A total of 30 trained students participated in Stage II. The goal of Stage II was to propose a system performance evaluation method to evaluate the performance of the new and existing systems according to the concerned factors of smartphone users after actual system use. Finally, based on our research model and system performance evaluation method, we put forward conclusions and suggestions that schools could use as references for future system procurements and updates.