Empirical Bayes, Machine Learning, and Policy Learning
Paper Session
Sunday, Jan. 3, 2027 8:00 AM - 10:00 AM (EST)
- Chair: Matthew Masten, Duke University
Policy Learning with Compliance Guarantee
Abstract
We study optimal policy learning where a policymaker (PM) uses data from a source population to design treatment assignments for a target population under a budget constraint. Because of the budget constraint, the PM needs to consider both treatment effects and individuals’ incentives for treatment participation to minimize wasted resources. The main challenge is that treatment participation incentives may differ between the two populations. We develop a maximin approach that maximizes the minimum of the PM’s expected objective across all possible incentive configurations. We show that this optimal policy learning problem can be reformulated using stochastic dominance constraints, where the optimal assignment prioritizes individuals most likely to comply with the treatment.Automatic Inference for Value-Added Regressions
Abstract
A large empirical literature regresses outcomes on empirical Bayes shrinkage estimates of value-added, yet little is known about whether this approach leads to unbiased estimates and valid inference for the downstream regression coefficients. We study a general class of empirical Bayes estimators and the properties of the resulting regression coefficients. We show that estimators can be asymptotically biased and inference can be invalid if the shrinkage estimator does not account for heteroskedasticity in the noise when estimating value added. By contrast, shrinkage estimators properly constructed to model this heteroskedasticity perform an automatic bias correction: the associated regression estimator is asymptotically unbiased, asymptotically normal, and efficient in the sense that it is asymptotically equivalent to regressing on the true (latent) value-added. Further, OLS standard errors from regressing on shrinkage estimates are consistent in this case. As such, efficient inference is easy for practitioners to implement: simply regress outcomes on shrinkage estimates of value-added that account for noise heteroskedasticity.Compound Selection Decisions: An Almost SURE Approach
Abstract
This paper proposes methods for compound selection decisions in a Gaussian sequence model where welfare, defined as the expected utility of a data-dependent decision rule, is the objective. Inspired by Stein’s unbiased risk estimate (SURE), we introduce ASSURE, a family of estimators for welfare. ASSURE enables selection of rules from a pre-specified class by optimizing estimated welfare, thereby borrowing strength across noisy payoff estimates. A leading variant ASSURE* is nearly unbiased and achieves near-parametric rates, yielding rules with favorable regret properties conditional on unknown parameters. When the pre-specified class is derived from random-effects models for decision payoffs, these regret guarantees provide robustness to potential prior misspecification, improving the empirical Bayes approach. We apply ASSURE to the selection of Census tracts for economic opportunity, the identification of discriminating firms, and the analysis of p-value decision procedures in A/B testing.JEL Classifications
- C1 - Econometric and Statistical Methods and Methodology: General