Skip to main content

Welcome to a Grasp lesson

Create a free account to keep studying and create your own study path.

Lesson 44

Estimating Causal Effects with Interference and Carryover

Recommended resources

Introduction

In our previous lesson, we successfully conducted a parameter recovery exercise, confirming that our DAG-informed analysis plan could accurately estimate a known causal effect from simulated data. That analysis, however, was based on the critical assumption of no interference—the Stable Unit Treatment Value Assumption (SUTVA)—where each individual was treated as an isolated system.

This lesson confronts the reality of our interconnected vee triad, where that assumption is invalid. We will now address the learning outcome: Estimate direct, spillover, and total effects from the experimental data using a model that accounts for interference and carryover. When one member of the triad receives a treatment (e.g., a specific communication style), their outcome is not the only one affected. Their partners' satisfaction levels may also change, a phenomenon known as interference or spillover. Furthermore, in our crossover design, treatments from previous periods may have lingering, or carryover, effects on the present.

Our goal is to dissect the total impact of a treatment into its distinct components: the effect on the person receiving it (direct effect) and the effects on their partners (spillover effects), while also controlling for effects from the past (carryover effects).


Visualizing a World with Interference and Carryover

Before we formalize these concepts, let's build a visual intuition. In a simple experiment, we imagine an arrow from "Treatment" to "Outcome." In our complex system, the causal pathways are far more numerous.

This diagram illustrates the various causal pathways in a system with two units over three time periods. In our triad, you can imagine a third unit interacting in a similar fashion. The arrows show how a treatment can have a direct effect, spillover effects on partners, and carryover effects over time.

This diagram reveals several types of effects we must consider:

  • Direct Effect (Blue Arrow): The treatment in Period 1 affects Unit 1's outcome in Period 1. In our scenario, this is how a living arrangement affects the satisfaction of the person whose arrangement is directly altered.
  • Treatment Spillover Effect (Light Blue Dashed Arrow): The treatment for Unit 1 in Period 1 affects Unit 2's outcome in the same period. This is the core of interference: one person's treatment spilling over to affect their partner.
  • Carryover Effect (Green Dotted Arrow): The treatment for Unit 1 in Period 1 affects the outcomes of both Unit 1 and Unit 2 in a future period (Period 2).
  • Unit Peer Effect & Autocorrelation (Pink/Red Dashed Arrows): These represent other dependencies in the system, such as individuals influencing each other directly, or an individual's state being correlated with their own past states, independent of the treatment.

These effects can be grouped to define our primary estimands.

This figure illustrates how to define effects in a clustered setting. In our case, the triad is a single, fully-interconnected cluster. The "direct effect" is the impact on a treated individual within a partially-treated cluster, while the "within-cluster spillover effect" captures the impact on untreated individuals in that same cluster. The "total effect" compares treating the entire cluster to treating none of it.

Formalizing Interference: Exposure Mappings

Your background in experimental design has equipped you with the principles of SUTVA. The "no interference" clause of SUTVA posits that a unit's potential outcomes depend only on their own treatment assignment. When this is violated, a unit's potential outcome becomes a function of the entire treatment vector for all units in the population.

This creates a high-dimensional problem. The concept of an exposure mapping provides a structured way to simplify it. An exposure mapping is a function that summarizes the complex treatment vector into a few relevant "exposure" conditions for each individual.

The following reading from the paper "Population Interference in Panel Experiments" provides the formal foundation for this concept, which is central to modern causal inference with interference.

[PDF] Population Interference in Panel Experiments

This paper develops a general framework for causal inference in panel experiments where both interference between units and carryover effects over time are present. It's a rigorous treatment that will ground our practical modeling exercise.

Please read Section 2, Setup, starting from the subsection "Potential outcomes and exposure mappings". This formally defines how an outcome for unit i at time t depends on the entire treatment history and how an "exposure mapping" simplifies this. Then, read about Locally Effective Assignments (LEA) and review the subsequent Example 1. This provides a concrete formulation that includes both spillover (from neighbors) and carryover (from the previous time step), which is a direct parallel to the dynamics in our triad.

As the reading makes clear, instead of considering every possible combination of treatments for all units across all time, we can define a specific exposure for each person. For person A in our triad at time , a relevant exposure mapping might be:

This vector captures:

  • : Person A's own current treatment (for the direct effect).
  • : The partners' current treatments (for spillover effects).
  • : Person A's own treatment in the previous period (for a simple carryover effect).

Defining the Causal Estimands

With a defined set of exposures, we can now precisely state what we want to measure. The paper you just read introduces the concept of the Temporal Exposure Contrast (TEC), which is a generalized form of a causal effect.

[PDF] Population Interference in Panel Experiments

Now that we have the concept of an exposure, we can define our causal quantities of interest.

In the same paper, continue in Section 2.3, Causal effects. Focus on the definitions of the Total Effect and then review the definitions of the Temporal Exposure Contrast (TEC) and Average Temporal Exposure Contrast (ATEC).

The TEC, , is the average difference in outcomes at time when units are subjected to exposure versus exposure . This is exceptionally powerful. By choosing our exposures and carefully, we can isolate exactly the effect we care about:

  • Direct Effect: Compare exposure to . (What is the effect of treating A, holding B and C as control?)
  • Spillover Effect: Compare exposure to . (What is the effect of treating B on A's outcome, when A is in control?)
  • Total Effect: Compare exposure to . (What is the effect of treating everyone vs. no one?)

From Theory to Practice: An Estimation Model

While design-based Horvitz-Thompson estimators (as mentioned in the readings) are a valid way to estimate any given TEC, a regression framework offers a flexible, model-based approach to estimate multiple effects at once and incorporate continuous confounders. This approach is a natural extension of the model from our previous lesson.

Let's construct a model for Person A's satisfaction at time , which we'll call . We assume our treatment is binary (e.g., 1 = new living arrangement, 0 = baseline). Our predictors will now include terms for our defined exposures and confounders:

Interpreting the coefficients gives us our effects of interest:

  • : The direct effect of the treatment on person A.
  • : The spillover effect from person B's treatment onto person A.
  • : The direct carryover effect of A's own past treatment on their present satisfaction.
  • : The spillover carryover effect from B's past treatment onto A's present satisfaction.

R Implementation: Estimating Effects from Simulated Data

Let's put this model to the test with an R simulation. We will generate data for our three individuals (A, B, C) over 100 time periods. The data generating process will explicitly include direct, spillover, and carryover effects, plus some random noise. Then we'll fit our model and see if we can recover the true parameters.




# Load libraries
library(dplyr)
library(tidyr)




# --- 1. Simulation Setup ---
set.seed(123)
n_periods <- 100
individuals <- c("A", "B", "C")
n_individuals <- length(individuals)




# True causal parameters we want to recover
true_direct_effect <- 0.8
true_spillover_effect <- -0.3 # Treatment on others has a negative effect on you
true_carryover_effect <- 0.2  # Past treatment has a positive lingering effect




# Generate a randomized treatment schedule for the triad
# In each period, one person is randomly chosen for treatment (T=1)
treatment_schedule <- data.frame(
  period = 1:n_periods,
  treated_person = sample(individuals, n_periods, replace = TRUE)
) %>%
  mutate(T_A = as.integer(treated_person == "A"),
         T_B = as.integer(treated_person == "B"),
         T_C = as.integer(treated_person == "C")) %>%
  select(-treated_person)




# --- 2. Generate Outcome Data (Satisfaction) ---
# Create a long-format dataset
full_data <- treatment_schedule %>%
  crossing(individual = individuals) %>%
  arrange(individual, period)




# Calculate spillover and lag terms
full_data <- full_data %>%
  group_by(period) %>%
  mutate(T_spillover = (T_A[individual == "A"] * (individual != "A") +
                        T_B[individual == "B"] * (individual != "B") +
                        T_C[individual == "C"] * (individual != "C"))) %>%
  ungroup() %>%
  mutate(T_direct = case_when(
           individual == "A" ~ T_A,
           individual == "B" ~ T_B,
           individual == "C" ~ T_C)) %>%
  group_by(individual) %>%
  mutate(T_direct_lag1 = lag(T_direct, default = 0)) %>%
  ungroup()




# Generate satisfaction based on the true effects
full_data <- full_data %>%
  mutate(
    satisfaction = 5 +  # Baseline satisfaction
      true_direct_effect * T_direct +
      true_spillover_effect * T_spillover +
      true_carryover_effect * T_direct_lag1 +
      rnorm(n(), 0, 1) # Random noise
  )




# --- 3. Fit the Estimation Model ---
# We use a fixed-effects model to account for baseline differences between individuals
estimation_model <- lm(satisfaction ~ T_direct + T_spillover + T_direct_lag1 + factor(individual), data = full_data)




# --- 4. Examine the Results ---
summary(estimation_model)

Interpreting the R Output

When you run this code, the summary(estimation_model) will produce a coefficients table. It will look something like this:

Term Estimate Std. Error ...
(Intercept) ... ... ...
T_direct 0.821 0.16 ...
T_spillover -0.335 0.12 ...
T_direct_lag1 0.195 0.12 ...
... ... ... ...

Look at the Estimate column for our key predictors:

  • T_direct: The estimate is 0.821, very close to our true direct effect of 0.8.
  • T_spillover: The estimate is -0.335, very close to our true spillover effect of -0.3.
  • T_direct_lag1: The estimate is 0.195, very close to our true carryover effect of 0.2.

The model successfully recovered the underlying causal parameters we embedded in the data. This demonstrates that a linear model, when correctly specified to include terms for interference and carryover, is a viable and powerful tool for estimating these complex effects.


A Glimpse at Heterogeneous Effects

Our model assumes that the direct, spillover, and carryover effects are constant for everyone. But what if the effect of a treatment depends on a person's characteristics? This is the domain of Heterogeneous Treatment Effect (HTE) estimation.

Susan Athey and Stefan Wager: Estimating Heterogeneous Treatment Effects in R

This seminar by Susan Athey and Stefan Wager, pioneers in this field, introduces methods for estimating HTEs. While the methods are advanced, the motivation is key to our project.

Watch the segment explaining the motivations for studying HTE. The speaker discusses why we might care about identifying subpopulations for whom a treatment works differently. This aligns perfectly with our goal to find what activities work for this specific triad, rather than assuming a one-size-fits-all effect.

Advanced methods like Causal Forests, which are discussed in the video, can estimate a personalized treatment effect, , for an individual with characteristics . While we are using a simpler linear model for now, it's important to recognize that this is a major frontier in causal inference and directly relevant to the personalized nature of your goal.


Conclusion

In this lesson, we moved beyond the simplistic world of no interference and embraced the complexity of our interconnected triadic system. We saw how interference and carryover effects violate SUTVA and require more sophisticated models.

Key Takeaways:

  • In interconnected systems, interference (spillover) and carryover effects are crucial to model.
  • Exposure mappings provide a formal framework for defining a unit's effective treatment based on the full treatment schedule of the system.
  • Causal effects can be decomposed into direct, spillover, and total effects by defining appropriate contrasts between exposures (TECs).
  • A linear model that includes terms for own treatment, partner treatments, and lagged treatments is a practical and powerful tool for estimating these different effects from experimental data.

Having estimated our primary causal effects, a critical question remains: how much should we trust these numbers? Our model relies on the assumption that we have measured all relevant confounders. In the next lesson, we will tackle this head-on by learning how to conduct a sensitivity analysis for unmeasured confounding, which will allow us to quantify the robustness of our conclusions.