14 minutes
Measure benefits, burdens, and implementation Select an outcome, a process measure, and a balancing measure.
What you’ll be able to do Select an outcome, a process measure, and a balancing measure. Identify a privacy risk in a proposed metric. Create a stopping rule for unintended harm. Measure benefits, burdens, and implementation An intervention can improve one measure while making another part of the work worse. A required second review might improve consistency but delay urgent decisions. A standard script might reduce omissions but make it harder to respond to a person’s actual question. A useful evaluation includes a balancing measure: an indicator of an important burden or unintended effect. This prevents a narrow definition of success from concealing costs transferred to staff or service users.
Use three complementary measures. The process measure asks whether the activity occurred as intended. The outcome measure asks whether the relevant result changed. The balancing measure asks what else became harder or riskier. For a clarification step, these might be the proportion of eligible cases offered clarification, the completeness of information at decision time, and the additional delay introduced. These are illustrative choices, not a required agency measurement framework. Adapt them to the actual purpose and authority of the work.
Protect privacy and avoid inappropriate personal assessment. Do not collect IAT scores, inferred IDI orientations, trauma narratives, or personal identity disclosures simply to make a course evaluation look comprehensive. If demographic analysis is authorized and relevant, use appropriate safeguards, especially for small groups. Explain who can see the information and what decisions it will inform. A voluntary learning program should not quietly become a source of personnel ratings or a test of ideological agreement.
Define a stopping or revision rule before implementation. A rule might require review if the change introduces a serious access barrier, produces an unacceptable delay, or results in information being shared beyond its authorized purpose. Use qualified judgment about thresholds rather than inventing a number with no basis in the work. Invite feedback that can reveal problems outside the chosen metrics. An affected person’s account should not be dismissed merely because a dashboard is green. Good measurement supports responsible attention; it does not replace it. The aim is to learn whether the intervention improves the intended decision without imposing avoidable burdens or creating a new kind of exclusion.
Private reflection: Who could bear the cost of a change that looks successful on your preferred measure?
Concepts to carry into practice Mechanism
The proposed explanation of how an activity changes a specific process or behavior.
Outcome measure
Evidence about the result the change was intended to improve.
Balancing measure
Evidence about an important burden or unintended effect elsewhere in the work.
Causal claim
A claim that the intervention produced the change; it requires a design capable of addressing alternative explanations.
Put the learning to work What you can change Review the delay as a balancing outcome and revise or pause the process where needed.
What to watch for A single favorable metric can hide harm transferred elsewhere in the process.
Your next step Define process, outcome, and balancing measures plus one condition that requires review or pause.
Carry this forward Improved documentation does not justify ignoring a new access barrier created by the intervention.
A single favorable metric can hide harm transferred elsewhere in the process.
Define process, outcome, and balancing measures plus one condition that requires review or pause.
A fictional case, an explanation of the available responses, private reflection, and an applied next step.
Define process, outcome, and balancing measures plus one condition that requires review or pause.
Browse and download only. Course notes are not typed or saved on this page.
Reset this lesson
Previous lesson Next lesson Carry this into practice Move from an appealing training idea to a testable change, with behavioral outcomes, ethical safeguards, and honest limits on what a pilot can establish.
Return to the experience: What did you notice or try, whose perspective informed it, and what would you keep or adjust?
Participation and course completion in this program do not count toward DHS-required training credits unless management, a director, or DHS leadership expressly approves an exception.
