« Back to Results

Treatment Effects: Theory and Implementation

Paper Session

Friday, Jan. 5, 2024 8:00 AM - 10:00 AM (CST)

Convention Center, 221B
Hosted By: American Economic Association
  • Chair: Serena Ng, Columbia University

Negative Weights are No Concern in Design-Based Specifications

Kirill Borusyak
,
University of California-Berkeley
Peter Hull
,
Brown University

Abstract

Recent work shows that popular partially-linear regression specifications can put negative weights on some treatment effects, potentially producing incorrectly-signed estimands. We counter by showing that negative weights are no concern in design-based specifications, in which the controls span the conditional expectation of the treatment. Specifically, the estimands of such specifications are convex averages of causal effects with “ex-ante” weights that average the potentially negative "ex-post" weights across possible treatment realizations. This result extends to design-based instrumental variable estimands under a first-stage monotonicity condition, and applies to "formula" treatments and instruments, such as shift-share instruments.

Event Studies with Continuous Treatment

Pedro H.C. Sant’Anna
,
Emory University
Andrew Goodman-Bacon
,
Federal Reserve Bank of Minneapolis
Brantly Callaway
,
University of Georgia

Abstract

This paper builds on the identification results and estimation tools for continuous DiD designs in Callaway, Goodman-Bacon, and Sant'Anna (2023) to discuss aggregation strategies for event studies with continuous treatments. Estimates from continuous designs are functions of the treatment dosage/intensity variable. Nonparametric plots of these functions show heterogeneity across doses, but not heterogeneity over time. Event-study-type plots of aggregated parameters achieve the opposite. We describe how partially aggregating across treatment doses and event time can lead to readable yet nuanced figures that reflect how causal effects evolve over time, potentially in different parts of the treatment dose distribution.

Empirical Bayes Approaches to Parallel Trends

Soonwoo Kwon
,
Brown University
Ashesh Rambachan
,
Massachusetts Institute of Technology
Jonathan Roth
,
Brown University

Abstract

Researchers are often concerned about the validity of the parallel trends assumption underlying difference-in-differences analyses. Recent work has proposed partial-identification approaches that bound the worst-case violation of parallel trends using pre-treatment differences in trends (“pre-trends”). Rather than focusing on worst-case bounds, this paper develops Bayes and empirical Bayes approaches to dealing with possible violations of parallel trends. In the Bayesian approach, the econometrician places a prior over the possible violations of parallel trends and then updates the prior using the observed pre-trends. In the empirical Bayes approach, the prior on post-treatment violations of parallel trends is calibrated using the pre-trends.

Difference-in-Differences Estimators with Continuous Treatments and No Stayers

Clement de Chaisematin
,
Sciences Po
Xavier D’Haultfoeuille
,
CREST
Gonzalo Vazquez-Bare
,
University of California-Santa Barbara

Abstract

Many treatments such as prices, taxes or temperatures are continuous in nature. Applied researchers usually rely on two-way fixed effect regressions to estimate treatment effects in such cases. However, such estimators are not robust to heterogeneous treatment effects in general, and rely on linearity of treatment effects. We develop a difference-in-difference strategy for continuous treatments without imposing such restrictions, when the treatment of all units changes between periods. We extend the nonparametric results of de Chaisemartin et al. (2023) to this setup and present a parametric approach that overcomes some limitations of the nonparametric approach.

When to Aggregate Data across Time for the Synthetic Control Method

Liyang Sun
,
University College London and CEMFI
Eli Ben-Michael
,
Carnegie Mellon University
Avi Feller
,
University of California-Berkeley

Abstract

The synthetic control method (SCM) is a popular approach for estimating the impact of a treatment on a single unit in panel data settings. The “synthetic control” is a weighted average of control units that balances the treated unit’s pre-treatment outcomes as closely as possible. Two challenges arise with higher frequency data, such as when the outcome is measured every month versus every year: (1) because the problem is higher dimensional, achieving excellent pre-treatment fit is typically more challenging; and (2) even when this is possible, higher-frequency observations raise the possibility of bias due to overfitting to noise. Casting high-frequency data in a linear factor model, we argue that under some conditions, aggregating the outcome into lower-frequency observations can help reduce the bias of SCM, both by achieving better pre-treatment fit in practice and by reducing the risk of overfitting to noise. We illustrate this with a simulation study and an applied example.
JEL Classifications
  • C1 - Econometric and Statistical Methods and Methodology: General
  • C4 - Econometric and Statistical Methods: Special Topics