In the construction of "Double First-class" universities, how to establish an evaluation system of universities' scientific and technological innovation capacity with Chinese characteristics and international standards will determine the direction and level of improvement of Chinese university?s technological innovation capacity. The system of scientific and technological innovation in university is a complex system, and the existing evaluation index and evaluation system may be difficult to meet the actual needs of the national construction of "Double First-class" universities in the new situation, so the evaluation index should be a breakthrough and innovation. This paper probes into the existing problems in the evaluation system of scientific research in China, systematically investigate the common and different features of scientific research evaluation in Britain, America, France and Australia, puts forward the new connotation of the structure dimension of Chinese universities 'scientific and technological innovation capacity, and points out the basic criterion of constructing the evaluation system of university scientific and technological innovation capacity: First, design of indicators should reflect the development trend of the world, and reflect the cultural characteristics and historical background of Chinese universities. Second, it is necessary to according to the "world standard", reflect the value orientation and practice standard of Chinese university construction. Third, taking differentiated design and establishing a classification evaluation standard. Fourth, the evaluative dimension should reflect the diversification of the evaluation's content, especially considering to optimize overall scientific research ecology.