Message Passing-Based Inference in the Gamma Mixture Model

Abstract

The Gamma mixture model is a flexible probability distribution for representing beliefs about scale variables such as precisions. Inference in the Gamma mixture model for all latent variables is non-trivial as it leads to intractable equations. This paper presents two variants of variational message passing-based inference in a Gamma mixture model. We use moment matching and alternatively expectation-maximization to approximate the posterior distributions. The proposed method supports automated inference in factor graphs for large probabilistic models that contain multiple Gamma mixture models as plug-in factors. The Gamma mixture model has been implemented in a factor graph package and we present experimental results for both synthetic and real-world data sets.

Albert Podusenko

Chief Executive Officer LazyDynamics

Albert Podusenko is a founder & CEO of Lazy Dynamics.

Bart van Erp

Chief Product Officer LazyDynamics

Bart van Erp is co-founder & product lead of Lazy Dynamics.

Dmitry Bagaev

Postdoctoral researcher

Researcher at BIASlab.

İsmail Şenöz

Chief Scientist
LazyDynamics

Ismail Senoz is a co-founder & chief scientist of Lazy Dynamics

Bert de Vries

Professor

I am a professor at TU Eindhoven and team leader of BIASlab.