School AI Tutor Pilot Evaluation Plan Builder
Plan a school AI tutor pilot evaluation with learning goals, safeguards, teacher workflow, consent needs, evidence collection, and rollout criteria.
Prompt Template
You are an education technology coordinator designing an evaluation plan for an AI tutor pilot. Build the plan for: School context: [grade levels, subject, class size, schedule, device access] AI tutor tool: [name if known, core features, content limits, languages, accessibility features] Learning goal: [math practice, reading support, writing feedback, language learning, exam review] Pilot duration: [weeks, semester, intervention window] Participants: [whole class, small group, intervention students, opt-in families] Teacher role: [lesson integration, monitoring, reviewing outputs, assigning practice, feedback] Student safeguards: [privacy, age restrictions, content filters, academic integrity, bias concerns] Consent and policy needs: [parent notice, district approval, data processing, accessibility review] Baseline evidence: [grades, assessment data, work samples, attendance, confidence survey] Success metrics: [learning gains, engagement, teacher workload, equity, safety incidents] Comparison approach: [pre/post, matched group, teacher observation, no comparison group] Constraints: [limited budget, union rules, district procurement, multilingual learners, IEP/504 needs] Create: 1. Pilot purpose, research questions, and decision criteria. 2. Student selection and equity plan. 3. Teacher workflow for setup, classroom use, monitoring, and follow-up instruction. 4. Safeguards checklist for privacy, bias, accessibility, age appropriateness, and academic integrity. 5. Parent, student, and staff communication drafts. 6. Evidence collection plan with baseline, during-pilot, and post-pilot measures. 7. Observation protocol for teacher notes and student behavior. 8. Issue log for inaccurate feedback, unsafe content, overreliance, access gaps, and support needs. 9. Evaluation report template with findings, limitations, recommendation, and rollout conditions. 10. Go/no-go/iterate decision rubric for expanding, pausing, or redesigning the pilot. Do not claim the tool improves learning without evidence. Flag legal, privacy, accessibility, procurement, and district policy questions for qualified review.
Example Output
Pilot Question
Can the AI tutor help grade 7 students practice fraction problem-solving for 15 minutes twice weekly without increasing teacher workload or widening access gaps?
Evidence Plan
| Measure | Baseline | During Pilot | End |
|---|---|---|---|
| Fraction quiz | Week 0 | None | Week 6 |
| Student confidence | Week 0 survey | Pulse check week 3 | Week 6 survey |
| Teacher workload | Setup estimate | Weekly 5-minute log | Debrief interview |
| Safety issues | N/A | Issue log | Summary and severity review |
Go Criteria
Proceed only if learning evidence is positive, teachers report manageable workflow, no unresolved safety incidents occur, and access gaps are addressed before expansion.
Tips for Best Results
- 💡Define the decision the pilot must support before choosing metrics.
- 💡Include teacher workload and student safeguards, not only test scores.
- 💡Use a clear issue log so inaccurate or unsafe tutor behavior is not hidden.
- 💡Separate promising classroom anecdotes from evidence strong enough for rollout.
Related Prompts
Lesson Plan Generator
Generate a detailed, engaging lesson plan for any subject and age group with learning objectives, activities, and assessments.
Study Guide Creator
Turn any textbook chapter, lecture, or topic into a structured study guide with key concepts, summaries, and practice questions.
Flashcard Set Generator
Generate a ready-to-import flashcard set for Anki or Quizlet on any topic with clear, effective front/back pairs.