Training on detecting and fixing reasoning flaws
The Hunt Lab has developed a research-based method for evaluating assessments called the Reasoning Stress Test (RST). This method helps analysts identify reasoning errors in order to evaluate their impact on the overall text, and amend them. Learning the method also helps analysts provide effective feedback to colleagues.
Developed with funding from the US Intelligence Community, and in consultation with professional analysts, the method is designed to improve reasoning in high-stakes situations. While the method was designed for intelligence analysis, the skills gained are useful in evaluating any type of reasoning, from business cases to workplace deliberations, and will benefit any organisation that values analytic rigour and whose productivity or reputation depends on making smart, well-justified decisions.
The training is practical and engages participants with interesting and challenging practice exercises. Participants learn by developing their skills on a diversity of assessments, including real intelligence reports and analysis, and the training technique is based on the best research on how expertise is acquired. You can read more about our research here.
Content
Part 1: What is good reasoning?
- The latest research on evaluating and improving reasoning
- How to identify the intended reasoning structure and unstated assumptions in a text
- Common types of reasoning stratagems all analysts should know
Part 2: Fixing reasoning flaws
- How to identify reasoning flaws
- How to assess the impact of reasoning flaws
- How to efficiently modify assessments to remove gaps and fix errors
Part 3: Effective feedback on reasoning
- Reasoning as a collaborative process
- The pitfalls of providing feedback and the art of clear and effective feedback
- How to provide useful and practical advice.
Benefits
Designed for making rigorous high-stakes assessments, the Reasoning Stress Test (RST) method is beneficial in a number of ways:
- Participants will learn techniques for avoiding or correcting reasoning errors that can undermine judgements
- Avoiding flaws can aid the clear and efficient communication of assessments
- The RST provides a method of effective feedback and can help establish a rigorous method of workplace peer-review.