Auxiliary gradient‐based sampling algorithms

Algorithmic framework for exact Bayesian variable selection and model averaging in linear models

Journal of the Royal Statistical Society, Series B

Volume80, Issue4
September 2018
Pages 749-767


We propose a scalable algorithmic framework for exact Bayesian variable selection and model averaging in linear models under the assumption that the Gram matrix is block-diagonal, and as a heuristic for exploring the model space for general designs. In block-diagonal designs our approach returns the most probable model of any given size without resorting to numerical integration. The algorithm also provides a novel and efficient solution to the frequentist best subset selection problem for block-diagonal designs. Posterior probabilities for any number of models are obtained by evaluating a single one-dimensional integral, and other quantities of interest such as variable inclusion probabilities and model-averaged regression estimates are obtained by an adaptive, deterministic one-dimensional numerical integration. The overall computational cost scales linearly with the number of blocks, which can be processed in parallel, and exponentially with the block size, rendering it most adequate in situations where predictors are organized in many moderately-sized blocks. For general designs, we approximate the Gram matrix by a block-diagonal matrix using spectral clustering and propose an iterative algorithm that capitalizes on the block-diagonal algorithms to explore efficiently the model space. All methods proposed in this paper are implemented in the R library mombf.

Would you like to receive more information about 
any of the projects?

Similar Cases

Method: Monte Carlo methods
Omiros Papaspiliopoulos, Nicolas Chopin
New book in Springer Series in Stadistics. An Introduction to all aspects of particle filtering: the algorithms, their uses in different areas, their computer implementation in Python and the supporting theory
Michalis K. Titsias, Omiros Papaspiliopoulos
Algorithmic framework for exact Bayesian variable selection and model averaging in linear models

How we can help


Let us train you to acquire those data science analytics skills that you or your team are missing.


Need some help in any analytics challenge you are facing? Get your analytics to the next level: count on us as expert consultants!

Contact us

We’d love to hear from you… Drop us a line to get in touch!


Data Sciencce Center Barcelona Graduate School of Economics Ramón Trías Fargas, 25-27 08005 Barcelona, Spain.

Join our LinkedIn Group


Case studies

About DSC



Stay tuned for Data Science updates

Subscribe to our Newsletter and you will receive the latest news about our work, studies, publications and more.




© Barcelona Graduate School of Economics. All rights reserved.