A Skewness-Based Criterion for Addressing Heteroscedastic Noise in Causal Discovery
Lin, Yingyu, Huang, Yuxing, Liu, Wenqin, Deng, Haoran, Ng, Ignavier, Zhang, Kun, Gong, Mingming, Ma, Yi-An, Huang, Biwei
Real-world data often violates the equal-variance assumption (homoscedasticity), making it essential to account for heteroscedastic noise in causal discovery. In this work, we explore heteroscedastic symmetric noise models (HSNMs), where the effect $Y$ is modeled as $Y = f(X) + \sigma(X)N$, with $X$ as the cause and $N$ as independent noise following a symmetric distribution. We introduce a novel criterion for identifying HSNMs based on the skewness of the score (i.e., the gradient of the log density) of the data distribution. This criterion establishes a computationally tractable measurement that is zero in the causal direction but nonzero in the anticausal direction, enabling the causal direction discovery. We extend this skewness-based criterion to the multivariate setting and propose SkewScore, an algorithm that handles heteroscedastic noise without requiring the extraction of exogenous noise. We also conduct a case study on the robustness of SkewScore in a bivariate model with a latent confounder, providing theoretical insights into its performance. Empirical studies further validate the effectiveness of the proposed method.
Oct-8-2024
- Country:
- North America > United States
- New York (0.04)
- California > San Diego County
- San Diego (0.04)
- Europe
- United Kingdom > England
- Cambridgeshire > Cambridge (0.04)
- Germany > Baden-Württemberg
- Tübingen Region > Tübingen (0.04)
- United Kingdom > England
- North America > United States
- Genre:
- Research Report (1.00)
- Industry:
- Government > Regional Government (0.46)
- Technology: