Hoop Tests and Smoking Guns for Event 1 Hypotheses

Introduction

In our last lesson, we brought a high degree of order to our investigation of Event 1 by constructing an evidence matrix. This allowed us to systematically map our collected facts against our primary and rival hypotheses, leading to the confident elimination of two rivals: the "pre-existing openness" theory (HR1) and the "husband's voyeurism" theory (HR2). Our primary hypotheses—H1 (wife's unmet needs) and H2 (husband's trust in his best friend)—survived this initial vetting, as they were consistent with the evidence.

Now, we move to a more granular and powerful level of analysis. The goal of this lesson is to apply more rigorous evidentiary standards to our surviving primary hypotheses. Simply being "consistent" with evidence is not enough; we want to test whether the evidence meets specific criteria that can dramatically increase our confidence in a causal claim. To do this, we will employ two core tools from the process-tracing toolkit: hoop tests and the search for smoking-gun evidence. This lesson will equip you to apply these tests to the primary hypotheses for Event 1, moving our analysis from one of plausibility to one of high inferential strength.

The Logic of Evidentiary Tests

Before applying the tests, it's essential to understand their underlying logic. In causal analysis, not all evidence is created equal. Some pieces of evidence are merely suggestive, while others can be nearly decisive. Process tracing formalizes this intuition by defining tests based on whether evidence is necessary or sufficient to affirm a hypothesis.

As someone with a background in formal logic and statistics, you can think of these tests as establishing specific logical conditions. A hoop test examines a necessary condition, while a smoking-gun test provides a sufficient one.

The following resources provide the canonical definitions and excellent explanations of these concepts.

[PDF] Understanding Process Tracing - Political Science at UC Berkeley

This seminal paper by David Collier provides the academic foundation for the four process-tracing tests. It uses the famous Sherlock Holmes case of "Silver Blaze" to illustrate the logic of each test.

Please begin by reading the introductory section on causal inference and review the summary in Table 1, which defines the tests based on necessity and sufficiency. Then, read the detailed explanations for Hoop Tests and Smoking-Gun Tests. Pay close attention to the examples in Table 4 (Hoop Tests) and Table 5 (Smoking-Gun Tests), as they provide concrete illustrations of how a single piece of evidence is evaluated.

Process Tracing Methodology

This video from the "Studying Politics & International Relations" channel offers a clear, practical explanation of the four tests, framing them in terms of certainty and uniqueness and using a helpful criminal justice analogy.

Watch the segment from the explanation of the four tests. The speaker effectively contrasts the logic of a hoop test (a suspect's alibi) with a smoking-gun test (finding the suspect over the body), which directly maps to the concepts of necessity and sufficiency we are exploring.

To summarize these resources:

Hoop Test: This test assesses a necessary condition. For a hypothesis to be true, it must pass this test (i.e., jump through the hoop). If the evidence required for the test is absent, the hypothesis is disconfirmed and can be eliminated. However, passing the test only affirms the hypothesis's continued plausibility; it does not prove it, as other rival hypotheses might also pass the same test.
- Logic: If H is true, we must observe E. We do not observe E. Therefore, H is false.
Smoking-Gun Test: This test assesses a sufficient condition. Finding a "smoking gun" provides strong, direct confirmation of a hypothesis. The presence of this evidence is sufficient to lend high confidence to the claim. However, the absence of a smoking gun does not disprove the hypothesis; it simply means we lack a single piece of uniquely damning evidence.
- Logic: If we observe E, H is very likely true. We observe E. Therefore, H is very likely true.

Now, let's apply these rigorous standards to the evidence for Event 1.

Applying the Tests to H2: Best Friend Trust

Let's begin with Hypothesis 2: The arrangement was viable and sustainable only because the bull was the husband's trusted best friend, which mitigated jealousy and anxiety.

This hypothesis makes a very strong claim of necessity. The "only because" phrasing practically invites a hoop test.

Hoop Test for H2

To test this, we must ask: What evidence must be present if this hypothesis is true? At a minimum, the husband must demonstrate a clear preference for the friend over any other potential partner for his wife, and explicitly link this preference to trust.

Let's re-examine our evidence:

E2: Husband's Testimony. In his solo interview, the husband states he would have "absolutely forbidden" the arrangement with a stranger, but felt secure because he'd known the bull since childhood and trusted him "implicitly."

This is a classic, successful hoop test.

The Hoop: The husband must have considered the bull's identity as a non-negotiable condition for his consent.
The Result: The evidence (E2) shows the hypothesis jumping cleanly through the hoop. His statement directly confirms that the arrangement was contingent on the specific identity of the third party.
The Implication: Had he stated, "I didn't care who it was, I was just ready for this," H2 would have failed this test and been eliminated. Because it passed, H2 remains a very strong contender.

Smoking-Gun Search for H2

Does any evidence for H2 rise to the level of a smoking gun? A smoking gun would be a piece of evidence so powerful that it makes the causal link almost undeniable.

Let's consider two more pieces of evidence:

E4: Communication Logs. These logs show the husband and bull discussing clear rules and boundaries before the first encounter, explicitly referencing their long friendship as the basis for being able to have such a frank and trusting conversation.
E9: Bull's Testimony. The bull's interview confirms that the husband initiated the conversation with him, framing it as a way to "help his wife and preserve his marriage."

While E4 and E9 are strongly consistent, E2 itself comes very close to being a smoking gun. The husband's statement is not just a hint; it's a direct articulation of the causal logic at the heart of H2. It functions as what Collier calls a "doubly decisive" piece of evidence in a limited sense: it eliminates the rival hypothesis that the identity of the bull was irrelevant, and it simultaneously provides powerful, sufficient confirmation for H2. The combination of E2, E4, and E9 provides overwhelming support for H2 as a core cause.

Applying the Tests to H1: Unmet Sexual Needs

Now let's turn to Hypothesis 1: The dynamic was caused by the wife's long-standing unmet sexual needs, which the arrangement was designed to fulfill.

This hypothesis posits a specific motivation as the primary driver for the wife's actions.

Hoop Test for H1

What is the necessary condition here? For this hypothesis to be true, the wife must have actually had unmet needs before the arrangement was conceived. If her needs were met, this hypothesis would have no factual basis.

Let's look at the evidence:

E1: Wife's Journal. Her private journal entries from two years before the arrangement describe feelings of sexual frustration and a desire for more adventurous experiences.
E5: Old Therapy Records. Records from five years prior show the couple discussing mismatched libidos.

This is another clear, successful hoop test.

The Hoop: Evidence of pre-existing sexual dissatisfaction must exist.
The Result: Both E1 and E5 show the hypothesis passing this test. The evidence confirms the existence of the motivating condition well before the outcome, establishing a critical part of the causal chain.
The Implication: If interviews and records had shown a history of mutual sexual satisfaction, H1 would be falsified. As it stands, it survives this crucial test.

Smoking-Gun Search for H1

Is there a smoking gun for the wife's motivation? This would be evidence that not only confirms her frustration but also links it directly to the solution chosen.

E1 (the journal) is very strong evidence, but it describes the problem, not necessarily the proposed solution. A true smoking gun might be a journal entry that reads: "My frustration is so great, I'm thinking of proposing an open relationship with my husband, perhaps with [Bull's Name], as the only way to feel fulfilled."

While we don't have that specific piece of evidence in our hypothetical dataset, the combination of evidence creates a powerful inferential chain.

E1 & E5: Establish the long-standing motive (the "push").
E6: Wife's Testimony. She states that raising the topic with her husband was "the most assertive thing she's ever done." This speaks to the high stakes and the strength of the underlying motivation.
E3: Friend's Testimony. The observation that the wife became "much more confident and radiant" after the arrangement began serves as evidence that the solution did, in fact, address the initial problem.

While no single piece of evidence for H1 is a definitive smoking gun on its own, their collective weight provides a very strong and compelling causal story. The journal entries (E1) are the strongest piece, confirming the central pillar of the hypothesis.

Conclusion

In this lesson, we moved beyond the basic consistency checks of the evidence matrix and applied the more demanding standards of hoop and smoking-gun tests. This process significantly increases our analytical confidence.

Here are the key takeaways:

Process-tracing tests provide rigorous standards for evidence. They force us to evaluate whether evidence confirms a necessary condition (hoop test) or provides a sufficient one (smoking gun).
Hoop tests are powerful tools for elimination. Both H1 (Unmet Needs) and H2 (Best Friend Trust) passed their respective hoop tests, meaning they survived a test that could have definitively falsified them.
Smoking guns provide powerful confirmation. For H2, the husband's testimony (E2) acted as both a passed hoop test and a near-smoking gun, making the causal claim exceptionally strong. For H1, while no single piece of evidence was a definitive smoking gun, the collection of evidence strongly pointed to the causal link between need and action.

By applying these tests, we have established that H1 and H2 are not just plausible—they are supported by specific, powerful pieces of evidence that meet high standards of causal inference.

In our next lesson, we will pivot to Event 2. You will construct an evidence matrix for the boudoir competition case, mapping the observed facts against the 'body type', 'attire contrast', and rival hypotheses.

Recommended resources