Course 208 · Work course 78

Evaluate a Program with Completion and Learning Evidence

Practice a fictional program evaluation brief with denominator definitions, matched pre/post results, attrition sensitivity, project-rubric evidence, a noncausal conclusion and a next measurement plan.

Before you start

Use the supplied fictional records on paper or in a local document. Keep drafts unsent and original files in your own software.

Understand Statistics in Everyday Claims See everything you’ll need

Free download · Original practice data · No external account required. Download the starter pack

What you’ll leave with

A fictional program evaluation brief with denominator definitions, matched pre/post results, attrition sensitivity, project-rubric evidence, a noncausal conclusion and a next measurement plan.

Start course Start without an account. Sign in to save lesson progress across devices.

Your project

Start with the practice files. Build your project one lesson at a time.

Practice files are free without an account. Sign in to save your project record in My Proof: a description, checklist, and optional work link. Keep the original files in your own app or notebook; saving a project record does not upload them.

  1. Get your materialsDownload practice filesSupplied practice cases, a blank working record, complete lesson instructions, and annotated worked examples.
  2. Make your projectView the project checklist Work in your own notebook, document, or software. Use the supplied practice examples when you prefer.
  3. Keep a private recordSave a project record Sign in to save a description and checklist, then return to update them.
Course handbook

Know the route before you begin.

Here’s what you’ll need and what you’ll make. You can return to this guide during any lesson.

Who this is for

Learners ages 14+ exploring how organizations coordinate useful work. No job or organization role is required.

Prepare before lesson one
  • Use the supplied fictional records on paper or in a local document. Keep drafts unsent and original files in your own software.
  • The linked foundation is recommended preparation; core practice here does not require an account, payment, partner or real learner information.
Your final project

Finish with proof you can use.

A fictional program evaluation brief with denominator definitions, matched pre/post results, attrition sensitivity, project-rubric evidence, a noncausal conclusion and a next measurement plan.

Save a project record in My Proof
See project checklist and review criteria

Keep your working files in your own notebook or software. Save a private description, checklist, and work link in My Proof.

What to include

  • Provide a stable dictionary for enrollment, completion, quiz and project measures.
  • Retain all eight enrolled aliases and document matched/missing/exception records.
  • Calculate denominator-specific rates and observed paired gain.
  • Show explicitly hypothetical missing-score bounds and independent project-rubric evidence.
  • Write a descriptive conclusion with causal limits and a next-evidence plan.

Review and revise

Use these criteria to check your work and choose what to improve.

  • All rates and means use the stated cohort or matched subset.
  • Missing and conflicting records are not silently dropped or invented.
  • Quiz and reviewed-project evidence retain their different standards.
  • The conclusion is descriptive and its limitations match the study design.
Three ideas to help you along the way
Three useful ideas

The rules behind the steps.

01

Define before counting

State the event, criterion and denominator before computing a rate.

02

Match the same people

A paired change compares valid pre/post records for the same IDs.

03

Bound the claim

Observed change, missing-score scenarios and causal effectiveness are different conclusions.

What do these words mean?
Key words

Key terms worth knowing.

Denominator
The specified population or records used beneath a rate.
Matched pair
A valid before-and-after record for the same identified learner.
Attrition
Loss of follow-up evidence from part of the original cohort.
Sensitivity bound
A hypothetical minimum or maximum under stated missing-value assumptions.
Causal claim
A claim that an intervention produced an effect rather than merely accompanied a change.
Your route

6 lessons.
One useful project.

Work in order the first time. Each lesson makes something the next lesson can use.

  1. 1
    Up next

    Define enrollment completion and assessed learning

    Define enrollment, completion, quiz threshold and project-review measures before calculating.

  2. 2
    14 min

    Match records without silently dropping learners

    Match pre/post records by unique alias while retaining unmatched and conflicting entries.

  3. 3
    14 min

    Calculate gain and denominator-specific rates

    Calculate matched-score change and completion rates with their proper denominators.

  4. 4
    16 min

    Test how missing follow-up changes the interpretation

    Test the range of conclusions under missing follow-up without inventing observed scores.

  5. 5
    14 min

    Compare quiz results with project rubric evidence

    Compare quiz threshold evidence with independently reviewed project criteria.

  6. 6
    19 min

    Write a supported evaluation with causal limits

    Write an evaluation conclusion bounded by sample, missingness and study design.

Use the tools

Tools to help you practice.

See all tools
Source transparency

Sources and further study.

Explore the references behind the lessons and take your learning further. Source notes explain access and reuse.

Institute of Education Sciences — Program Evaluation Toolkit
Source & access notes · checked 2026-10-01

This official reference supports the mapped concepts. The supplied exercise inputs and operating rules are original fictional practice, not universal legal requirements or qualification evidence.

Access: official search extract of program-evaluation toolkit; fullPDFreadererror on 2026-10-01; external resources are optional.

Reuse: Original fictional teaching and practice; source concepts paraphrased and linked, with no copied provider exercises.

Institute of Education Sciences — Missing Data in Education Research, ERIC record
Source & access notes · checked 2026-10-01

This official reference supports the mapped concepts. The supplied exercise inputs and operating rules are original fictional practice, not universal legal requirements or qualification evidence.

Access: official IES missing-data report metadata/search extract; fullreadererror on 2026-10-01; external resources are optional.

Reuse: Original fictional teaching and practice; source concepts paraphrased and linked, with no copied provider exercises.

FTC — protecting and minimizing personal information
Source & access notes · checked 2026-10-01

This official reference supports the mapped concepts. The supplied exercise inputs and operating rules are original fictional practice, not universal legal requirements or qualification evidence.

Access: readable official guide on 2026-10-01; external resources are optional.

Reuse: Original fictional teaching and practice; source concepts paraphrased and linked, with no copied provider exercises.

Ready when you are

Start with the first useful move.

You’ll always know what to do, what to make, and where to go next.

Start lesson one