Get our free extension to see links to code for papers anywhere online!Free add-on: code for papers everywhere!Free add-on: See code for papers anywhere!

Add to Chrome

Add to Firefox

Add to Edge

Robert E. McCulloch

Causal Inference with the Instrumental Variable Approach and Bayesian Nonparametric Machine Learning

Feb 01, 2021
Robert E. McCulloch, Rodney A. Sparapani, Brent R. Logan, Purushottam W. Laud

Figure 1 for Causal Inference with the Instrumental Variable Approach and Bayesian Nonparametric Machine Learning

Figure 2 for Causal Inference with the Instrumental Variable Approach and Bayesian Nonparametric Machine Learning

Figure 3 for Causal Inference with the Instrumental Variable Approach and Bayesian Nonparametric Machine Learning

Figure 4 for Causal Inference with the Instrumental Variable Approach and Bayesian Nonparametric Machine Learning

We provide a new flexible framework for inference with the instrumental variable model. Rather than using linear specifications, functions characterizing the effects of instruments and other explanatory variables are estimated using machine learning via Bayesian Additive Regression Trees (BART). Error terms and their distribution are inferred using Dirichlet Process mixtures. Simulated and real examples show that when the true functions are linear, little is lost. But when nonlinearities are present, dramatic improvements are obtained with virtually no manual tuning.

* 33 pages, 7 figures

Via

Access Paper or Ask Questions

BART: Bayesian additive regression trees

Oct 07, 2010
Hugh A. Chipman, Edward I. George, Robert E. McCulloch

Figure 1 for BART: Bayesian additive regression trees

Figure 2 for BART: Bayesian additive regression trees

Figure 3 for BART: Bayesian additive regression trees

Figure 4 for BART: Bayesian additive regression trees

We develop a Bayesian "sum-of-trees" model where each tree is constrained by a regularization prior to be a weak learner, and fitting and inference are accomplished via an iterative Bayesian backfitting MCMC algorithm that generates samples from a posterior. Effectively, BART is a nonparametric Bayesian regression approach which uses dimensionally adaptive random basis elements. Motivated by ensemble methods in general, and boosting algorithms in particular, BART is defined by a statistical model: a prior and a likelihood. This approach enables full posterior inference including point and interval estimates of the unknown regression function as well as the marginal effects of potential predictors. By keeping track of predictor inclusion frequencies, BART can also be used for model-free variable selection. BART's many features are illustrated with a bake-off against competing methods on 42 different data sets, with a simulation experiment and on a drug discovery classification problem.

* Annals of Applied Statistics 2010, Vol. 4, No. 1, 266-298
* Published in at http://dx.doi.org/10.1214/09-AOAS285 the Annals of Applied Statistics (http://www.imstat.org/aoas/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Via

Access Paper or Ask Questions