ASE PROGRAM EVALUATION FRAMEWORK The ASE Academy — intern-resources.html ================================================================================ THEORY OF CHANGE Program component being evaluated: Target population: If we: Then: Resulting in: Time horizon: ================================================================================ LAYER 1 — PROCESS DATA (what the program does) Sessions delivered: ___ individual ___ group ___ classroom Students served: ___ Unique students: ___ Curriculum lessons delivered: ___ Consultations: ___ teacher ___ family ___ MDT Referrals made: ___ Hours per ASCA component: Direct student services: ___ Indirect services: ___ Program planning/evaluation: ___ Professional development: ___ ================================================================================ LAYER 2 — PERCEPTION DATA (student/stakeholder report) Collection method: [ ] Survey [ ] Interview [ ] Focus group [ ] Observation Pre: ___________ Post: ___________ Follow-up: ___________ Instruments used: Individual-level outcomes (Pre/Post 1–5): "I know what to do when I feel overwhelmed at school." "There is an adult in this school I can talk to when something is hard." "I understand what my strengths are and how to use them." Environmental-quality items (Pre/Post 1–5) — ASE addition: "My teachers believe I can be successful." "When something is unfair at school, I feel like someone will listen." "The adults in this school understand what my life outside school is like." Key findings: Largest gain: Weakest change: Most important individual vs. environmental discrepancy: ================================================================================ LAYER 3 — OUTCOME DATA (what changed) Academic indicators: GPA change (program group vs. comparison): Attendance change: Course completion/failure rate: Disciplinary referrals (disaggregated): School climate indicators — ASE addition: School climate survey results: Office referral rate by location/teacher: Family engagement metrics: ================================================================================ ADVOCACY BRIEF SUMMARY Finding most clearly supporting program investment: Environmental finding pointing to needed system change: Recommended action for admin: Presentation format: [ ] 1-page summary [ ] Slide deck [ ] Verbal report ================================================================================ The ASE Academy | info@ASETheory.com | ASETheory.com