Working Together to Achieve in a Digital Age: Grant Evaluation Design

Year One Outcomes Identification of Technology Mentors for each school Identification of Learning Team members for each school Identification of District Core members for each district Year One Data Sources for Evaluation CBAM/ ETP Learning Spectrum for leaders and future participants (before any training takes place) - assess readiness for using school data to develop action plan as well as using inquiry, metacognitive, reading, and problem-solving strategies, and assessment best practices promoted by the project Nextstep tools (before any training takes place - 7 Skillcheck for pre/posttesting for TI Mentor readiness? Archival data participant list with TI Mentors, Learning Team and District Core Team members identified Year Two Outcomes Increased transforming learning experiences for students Increased curricular opportunities for students Increased student achievement in school-identified curricular areas Increased student technology literacy Year Two Data Sources for Evaluation CBAM/ ETP Learning Spectrum for leaders and participants NextSteps tools (in fall and spring?) - 7 Skillcheck pre/posttesting for TI Mentor readiness? Teacher implementation logs - for each unit developed for the project Archival data Units developed for the project (evaluate alignment to standards as well as to best practices promoted by the project) All student work products from units developed for the project Test Data NCE scores for reading and math for all students in participating schools (starting 2002-2003 for baseline) ISAT scores for each school (can we get this for the classroom?) Year Three Outcomes Increased transforming learning experiences for students Increased curricular opportunities for students Increased student achievement in school-identified curricular areas Increased student technology literacy Year Three Data Sources for Evaluation CBAM/ETP Learning Spectrum for leaders and participants NextSteps tools (in fall and spring?) - 7 (make sure includes email Tool) Skillcheck pre/posttesting for teacher readiness? Teacher implementation logs - for each unit developed for the project Archival data Units developed for the project (evaluate alignment to standards as well as to best practices promoted by the project) All student work products from units developed for the project Test Data NCE scores for reading and math for all students in participating schools (starting 2002-2003 for baseline) ISAT scores for each school (can we get this for the classroom?) Evaluation of Integrity of Intervention Focus groups and/or surveys of participants in spring of each year on implementation success and effectiveness of project for supporting implementation Participant evaluations of each training session Analysis of CBAM/ETP Learning Spectrum and Unit Implementation Logs Use of Nextstep tools (Tools 18, 19, 20) and Insta-Audit (Pillars I and II) to establish technology capacity for each building Level of use and effectiveness of web portal and Track-It PD (through rates of use by participants as well as surveys and/or focus groups) Level of support provided and effectiveness of core district teams, learning teams, and mentors (through surveys and/or focus groups)

Download document in PDF format. Note: This link will open in PDF format. You must have the "Acrobat Reader" program in order to view it.