Causal representation learning (CRL) aims to learn low-dimensional causal latent variables from high-dimensional observations. While identifiability has been extensively studied for CRL, estimation has been less explored. In this paper, we explore the use of empirical Bayes (EB) to estimate causal representations. In particular, we consider the problem of learning from data from multiple domains, where differences between domains are modeled by interventions in a shared underlying causal model. Multi-domain CRL naturally poses a simultaneous inference problem that EB is designed to tackle. Here, we propose an EB $f$-modeling algorithm that improves the quality of learned causal variables by exploiting invariant structure within and across domains. Specifically, we consider a linear measurement model and interventional priors arising from a shared acyclic SCM. When the graph and intervention targets are known, we develop an EM-style algorithm based on causally structured score matching. We further discuss EB $g$-modeling in the context of existing CRL approaches. In experiments on synthetic data, our proposed method achieves more accurate estimation than other methods for CRL.

Since proxy invariance indiff approaches data.

In many scientific applications, we observe a system in different conditions in which its components may change, rather than in isolation.

However, it is known that even with infinite i.i.d.

Although it is often argued that this representational format is useful in learning to solve many real-world down-stream tasks, there islittle empirical evidence that supports this claim.

We present a novel framework for unsupervised object-centric 3D scene understanding that generalizes robustly to out-of-distribution images.

We refer to them astarget-causing confounders.

Obviously in ANM-MM, all observations are generated by a set of g.m.s, which share the same functionform(f)butdifferinparametervalues(θ).