12 minutes
Read mixed evidence carefully Compare a foundational experiment with a registered follow-up study.
What you’ll be able to do Compare a foundational experiment with a registered follow-up study. Explain why a null finding has a bounded meaning. Avoid promising a performance gain from an untested local intervention. Read mixed evidence carefully Research is stronger when it can accommodate findings that do not match the original prediction. Stereotype-threat studies vary in population, task difficulty, cues, and setting. Some report effects; others do not. A registered report specifies important methods and analyses before results are known, reducing opportunities to choose a favorable account after the fact. Flore, Mulder, and Wicherts tested gender stereotype threat in Dutch students' mathematics performance and did not find the predicted overall effect in that study. That result is important evidence about those conditions.
A null finding does not prove that stereotypes never affect people. A positive laboratory result does not prove that the same mechanism explains a workplace outcome. Both statements would overreach. Ask what was manipulated, who participated, what outcome was measured, and how closely it resembles the proposed application. Notice the difference between a psychological mechanism, a demonstrated intervention, and a reasonable design practice. Explaining criteria may be good practice because it makes evaluation clearer even if it has not been shown to change performance through stereotype threat in your setting.
Avoid using research as a guarantee in a training pitch. 'This introduction will eliminate the achievement gap' is far stronger than the evidence supports. A responsible claim is that the team will make instructions clearer, avoid group-based judgments, and examine whether the change helps participants understand the task. If a local result improves, several explanations may remain. A small voluntary pilot cannot establish a causal psychological effect merely because participants liked it. Keep the theory available for thinking, and keep the observation precise enough that another person could assess it. This combination supports learning without turning a contested result into either dogma or a reason to ignore exclusion.
A fictional practice case A fictional trainer proposes a new opening script and predicts it will increase everyone's assessment scores. The script explains that practice is developmental and provides a scoring example. Five participants later say the instructions were clearer. Scores were not compared under equivalent conditions. The trainer has evidence about perceived clarity, not proof of a score increase or a specific psychological mechanism. The improvement can be retained without inflating the claim.
Private reflection Which feels harder: accepting an uncertain positive finding or taking a null result seriously? How could that preference shape your use of research?
Applied practice Write a two-sentence evidence note: one sentence about the proposed mechanism and one about limits on applying it to staff learning.
Carry this forward Evidence should update the scope and confidence of a claim without being stretched into a universal conclusion.
This accurately states both the useful finding and its limit.
Write a two-sentence evidence note: one sentence about the proposed mechanism and one about limits on applying it to staff learning.
Evidence should update the scope and confidence of a claim without being stretched into a universal conclusion.
Write a two-sentence evidence note: one sentence about the proposed mechanism and one about limits on applying it to staff learning.
Browse and download only. Course notes are not typed or saved on this page.
Mark this lesson completeReset this lesson
Previous lesson Next lesson Carry this into practice Understand the proposed mechanism, evaluate the limits of the evidence, and create conditions in which people can demonstrate their work without being reduced to a group stereotype.
Return to the experience: What did you notice or try, whose perspective informed it, and what would you keep or adjust?
Participation and course completion in this program do not count toward DHS-required training credits unless management, a director, or DHS leadership expressly approves an exception.