Academic Journal

Gibbs Priors for Bayesian Nonparametric Variable Selection with Weak Learners.

Bibliographic Details
Title: Gibbs Priors for Bayesian Nonparametric Variable Selection with Weak Learners.
Authors: Linero, Antonio R.1 (AUTHOR), Du, Junliang2 (AUTHOR)
Superior Title: Journal of Computational & Graphical Statistics. Jul-Sep2023, Vol. 32 Issue 3, p1046-1059. 14p.
Subject Terms: *DECISION trees, BOLTZMANN factor, REGRESSION trees, TENSOR products, BOOSTING algorithms, SPLINES
Abstract: We consider the problem of high-dimensional Bayesian nonparametric variable selection using an aggregation of so-called "weak learners." The most popular variant of this is the Bayesian additive regression trees (BART) model, which is the natural Bayesian analog to boosting decision trees. In this article, we use Gibbs distributions on random partitions to induce sparsity in ensembles of weak learners. Looking at BART as a special case, we show that the class of Gibbs priors includes two recently proposed models—the Dirichlet additive regression trees (DART) model and the spike-and-forest model—as extremal cases, and we show that certain Gibbs priors are capable of achieving the benefits of both the DART and spike-and-forest models while avoiding some of their key drawbacks. We then show the promising performance of Gibbs priors for other classes of weak learners, such as tensor products of spline basis functions. A Pólya Urn scheme is developed for efficient computations. for this article are available online. [ABSTRACT FROM AUTHOR]
Copyright of Journal of Computational & Graphical Statistics is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Business Source Premier
Description
Description not available.