Mathematics > Statistics Theory
[Submitted on 23 Oct 2020 (v1), last revised 15 Sep 2021 (this version, v2)]
Title:Smoothing and adaptation of shifted Pólya Tree ensembles
View PDFAbstract:Recently, S. Arlot and R. Genuer have shown that a model of random forests outperforms its single-tree counterpart in the estimation of $\alpha-$Hölder functions, $\alpha\leq2$. This backs up the idea that ensembles of tree estimators are smoother estimators than single trees. On the other hand, most positive optimality results on Bayesian tree-based methods assume that $\alpha\leq1$. Naturally, one wonders whether Bayesian counterparts of forest estimators are optimal on smoother classes, just like it has been observed for frequentist estimators for $\alpha\leq 2$. We dwell on the problem of density estimation and introduce an ensemble estimator from the classical (truncated) Pólya tree construction in Bayesian nonparametrics. The resulting Bayesian forest estimator is shown to lead to optimal posterior contraction rates, up to logarithmic terms, for the Hellinger and $L^1$ distances on probability density functions on $[0;1)$ for arbitrary Hölder regularity $\alpha>0$. This improves upon previous results for constructions related to the Pólya tree prior whose optimality was only proven in the case $\alpha\leq 1$. Also, we introduce an adaptive version of this new prior in the sense that it does not require the knowledge of $\alpha$ to be defined and attain optimality.
Submission history
From: Thibault Randrianarisoa [view email][v1] Fri, 23 Oct 2020 11:06:33 UTC (1,909 KB)
[v2] Wed, 15 Sep 2021 20:40:18 UTC (3,173 KB)
Current browse context:
math.ST
References & Citations
export BibTeX citation
Loading...
Bibliographic and Citation Tools
Bibliographic Explorer (What is the Explorer?)
Connected Papers (What is Connected Papers?)
Litmaps (What is Litmaps?)
scite Smart Citations (What are Smart Citations?)
Code, Data and Media Associated with this Article
alphaXiv (What is alphaXiv?)
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub (What is DagsHub?)
Gotit.pub (What is GotitPub?)
Hugging Face (What is Huggingface?)
Papers with Code (What is Papers with Code?)
ScienceCast (What is ScienceCast?)
Demos
Recommenders and Search Tools
Influence Flower (What are Influence Flowers?)
CORE Recommender (What is CORE?)
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.