School data often exists in disparate forms and locations, making it difficult to organize efficiently and to retrieve quickly (Thorn, 2001). Many computer systems are outdated and inadequate, and schools and districts often lack appropriate userfriendly software for data analysis (Bernhardt 2004; Wayman, Stringfield, & Yakimowski, 2004). Furthermore, educators frequently lack the skills of to make effective use of data (Baker, 2003; Choppin, 2002; Cizek, 2000; Cromey, 2000). To address these problems, for the past three years work at the National Center for Research on Evaluation, Standards, and Testing CRESST at UCLA has focused on the following objectives: (1) Design and develop a decision support tool, the web-based Quality School Portfolio (QSP) version 4.0; (2) Develop a standardized training system for trainers and end users with certification for trainers; (3) Implement a national rollout of QSP with multiple approaches to training and support; (4) Conduct evaluation research to evaluate the effectiveness of the features and functions of QSP, the effectiveness of the training, and the benefits of QSP use on educational improvement; and (5) Design requirements for the 5th generation of decision-support tools using results from the foregoing objectives. This report covers work related to these objectives over a three year period. Contains 33 figures (some color enhanced), and 12 Tables. Appended are color enhanced, and include: (1) History Subtab of the Students Tab; (2) Digital Portfolio; (3) Groups Tab; (4) Sample Reports from 24 Reporting Options; (5) Goals Tab; and (6) Standards Subtab of the Gradebook.