Message Passing-Based Inference for Time-Varying Autoregressive Models

Abstract

Time-varying autoregressive (TVAR) models are widely used for modeling of non-stationary signals. Unfortunately, online joint adaptation of both states and parameters in these models remains a challenge. In this paper, we represent the TVAR model by a factor graph and solve the inference problem by automated message passing-based inference for states and parameters. We derive structured variational update rules for a composite “AR node” with probabilistic observations that can be used as a plug-in module in hierarchical models, for example, to model the time-varying behavior of the hyper-parameters of a time-varying AR model. Our method includes tracking of variational free energy (FE) as a Bayesian measure of TVAR model performance. The proposed methods are verified on a synthetic data set and validated on real-world data from temperature modeling and speech enhancement tasks.

Publication
MDPI Entropy. Special Issue on Bayesian Inference in Probabilistic Graphical Models
Albert Podusenko
Albert Podusenko
Chief Executive Officer LazyDynamics

Albert Podusenko is a founder & CEO of Lazy Dynamics.

Wouter Kouw
Wouter Kouw
Assistant professor

I am an assistant professor working on active inference for mobile robots.

Bert de Vries
Bert de Vries
Professor

I am a professor at TU Eindhoven and team leader of BIASlab.