14 minutes
Interpret results and decide what happens next Distinguish observed results from a causal claim.
What you’ll be able to do Distinguish observed results from a causal claim. Explain why immediate change may not persist. Write a transparent continue-revise-stop decision. Interpret results and decide what happens next The end of a pilot is a decision point, not an obligation to produce a success story. Begin by comparing the results with the question and measures specified beforehand. Did the activity occur? Did the intended behavior change? Were there unexpected burdens? What alternative explanations remain? A result that challenges the original idea is useful if it prevents the organization from expanding an ineffective or harmful practice. Treat revision as part of responsible learning rather than as an embarrassment to conceal.
Time matters. An immediate response after a workshop may differ from practice several weeks later. Attention, novelty, and the conditions of measurement can affect early results. Research comparing implicit-bias interventions has highlighted the difference between short-term changes and persistence. For a workplace process, examine whether the new behavior remains usable when workload rises or staff change. Do not assume that a single favorable follow-up establishes permanent change. Choose a review interval that fits the mechanism and practical risks.
Report uncertainty in plain language. Say that a small pilot showed improved use of a clarification step, for example, while acknowledging that the sample cannot establish a stable change in disparities. Avoid replacing honest limitations with vague claims that the program transformed culture. Also avoid concluding that nothing matters because evidence is incomplete. A limited result can justify continuing a low-risk improvement with review, while a major expansion may require stronger evidence. The standard of evidence should match the consequence of the decision.
End with an explicit action: continue, revise, stop, or seek a more rigorous evaluation. Name the person responsible and the next review date. Preserve the original measures and record changes to the plan so later readers can understand the reasoning. Share an appropriate summary with people who contributed, including what did not work. Keep private learning responses separate from operational evaluation. This approach supports the program’s movement toward responsive practice without turning staff into scored subjects. The strongest claim is the one the evidence can sustain, coupled with a concrete plan for what the organization will do next.
Concepts to carry into practice Mechanism
The proposed explanation of how an activity changes a specific process or behavior.
Outcome measure
Evidence about the result the change was intended to improve.
Balancing measure
Evidence about an important burden or unintended effect elsewhere in the work.
Causal claim
A claim that the intervention produced the change; it requires a design capable of addressing alternative explanations.
Put the learning to work What you can change Continue the usable process with review while describing the outcome evidence as insufficient.
What to watch for The design may still establish feasibility and process improvement; it should be judged against the question it could answer.
Your next step Write a decision memo with results, limitations, unintended effects, next action, owner, and review date.
Carry this forward A limited process finding can support a proportionate decision without an unsupported claim about disparities.
The design may still establish feasibility and process improvement; it should be judged against the question it could answer.
Write a decision memo with results, limitations, unintended effects, next action, owner, and review date.
A fictional case, an explanation of the available responses, private reflection, and an applied next step.
Write a decision memo with results, limitations, unintended effects, next action, owner, and review date.
Browse and download only. Course notes are not typed or saved on this page.
Reset this lesson
Previous lesson Back to course Carry this into practice Move from an appealing training idea to a testable change, with behavioral outcomes, ethical safeguards, and honest limits on what a pilot can establish.
Return to the experience: What did you notice or try, whose perspective informed it, and what would you keep or adjust?
Participation and course completion in this program do not count toward DHS-required training credits unless management, a director, or DHS leadership expressly approves an exception.
