The ancient academy in China demonstrated some unique educational values, such as the school-running idea of independence and autonomy and the governance by famous experts, the instruction idea of being free and open and focusing on academy and morality cultivation, and the management concept of mind-oriented administration and student autonomy. At present time, Chinese universities have encounterred some difficulties in the process of talents cultivation, such as the administrativization, the incomplete implement of people-oriented concept and the inadequate attention on morality education. As a result, the educational ideas of ancient academy enlighten modern higher education mainly in the following aspects: the university should keep its relative independence, put the student-centered administration into practice, construct academic research atmosphere and promote academic communication, value morality cultivation and foster human spirit, and then the essence of these educational ideas will promote the reform and the development of higher education and improve the quality of talents cultivation in China.