Scalable inference for crossed random effects models


Analytics chemistry
Biometrika, Volume 107, Issue 1, March 2020, Pages 25–40


We develop methodology and complexity theory for Markov chain Monte Carlo algorithms used in inference for crossed random effects models in modern analysis of variance. We consider a plain Gibbs sampler and propose a simple modification, referred to as a collapsed Gibbs sampler. Under some balancedness conditions on the data designs and assuming that precision hyperparameters are known, we demonstrate that the plain Gibbs sampler is not scalable, in the sense that its complexity is worse than proportional to the number of parameters and data, but the collapsed Gibbs sampler is scalable. In simulated and real datasets we show that the explicit convergence rates predicted by our theory closely match the computable, but nonexplicit rates in cases where the design assumptions are violated. We also show empirically that the collapsed Gibbs sampler extended to sample precision hyperparameters significantly outperforms alternative state-of-the-art algorithms.

Would you like to receive more information about 
any of the projects?

Similar Cases

Method: Monte Carlo methods
Omiros Papaspiliopoulos, Nicolas Chopin
New book in Springer Series in Stadistics. An Introduction to all aspects of particle filtering: the algorithms, their uses in different areas, their computer implementation in Python and the supporting theory
Michalis K. Titsias, Omiros Papaspiliopoulos
Algorithmic framework for exact Bayesian variable selection and model averaging in linear models

How we can help


Let us train you to acquire those data science analytics skills that you or your team are missing.


Need some help in any analytics challenge you are facing? Get your analytics to the next level: count on us as expert consultants!

Contact us

We’d love to hear from you… Drop us a line to get in touch!


Data Sciencce Center Barcelona Graduate School of Economics Ramón Trías Fargas, 25-27 08005 Barcelona, Spain.

Join our LinkedIn Group


Case studies

About DSC



Stay tuned for Data Science updates

Subscribe to our Newsletter and you will receive the latest news about our work, studies, publications and more.




© Barcelona Graduate School of Economics. All rights reserved.