The evaluation index system is an important part of the comprehensive evaluation, and its validity will directly determine the quality of comprehensive evaluation,so it is very necessary to assess its effectiveness.Nowadays , with the in-depth research on comprehensive evaluation, more and more attention are paid to the index system's effectiveness by the scholars, and some methods have been proposed, but it is still lack of the system, full-scale research.Based on the researchs, this paper will analyze the existing methods of the index system's effectiveness -----Reliability & Validity Method, Coefficient of Validity Method,Structural Equation Model Method, Signal/Noise Ratio Method; RST Method, and hope to summarize their advantages, disadvantages and applicable occasions, so as to make the research of the index system effectiveness more perfect.