Understanding causal dependencies in observational data is critical for informing decision-making. These relationships are often modeled as Bayesian Networks (BNs) and Directed Acyclic Graphs (DAGs). Existing methods, such as NOTEARS and DAG-GNN, often face issues with scalability and stability in high-dimensional data, especially when there is a feature-sample imbalance. Here, we show that the denoising score matching objective of diffusion models could smooth the gradients for faster, more stable convergence. We also propose an adaptive k-hop acyclicity constraint that improves runtime over existing solutions that require matrix inversion. We name this framework Denoising Diffusion Causal Discovery (DDCD). Unlike generative diffusion models, DDCD utilizes the reverse denoising process to infer a parameterized causal structure rather than to generate data. We demonstrate the competitive performance of DDCDs on synthetic benchmarking data. We also show that our methods are practically useful by conducting qualitative analyses on two real-world examples. Code is available at this url: https://github.com/haozhu233/ddcd.

Neural Information Processing Systems http://nips.cc/

We strengthen previous results for variational algorithms by showing that they are competitive with any point-estimate predictor. Unlike previous work, we provide bounds on the risk of the Bayesian predictor and not just the risk of the Gibbs predictor for the same approximate posterior.

Neural Information Processing Systems http://nips.cc/

The Atlantic CEO's new book,, examines his complicated relationship with the sport. On this week's episode of, he talks about the ways tech is helping him become a better runner. To most of the world, Nicholas Thompson is known as an editor, an AI enthusiast, or something of a LinkedIn influencer. But the former WIRED editor in chief, who is now CEO of The Atlantic, is often better known to colleagues as . On Tuesday, Thompson is releasing . As the title suggests, it's a book about his commitment to running--Thompson runs a ridiculously fast marathon and holds the American 50K record for the 45-49 age group. Ultimately, though, the book examines the complicated relationship between the sport, Thompson, and his father, who first took him on a run when he was just 5 years old. Tech obsessives, of course, will also get their fix: includes plenty of science-backed training guidance and documents Thompson's experience training with elite Nike coaches. On this week's episode of, I talked to Thompson (who was also my first boss; he hired me as an intern at WIRED in 2008) about his book, the interplay between running and addiction, and what he thinks AI can do for runners for writers. It is a joy to be here with you at Condé Nast at WIRED. I loved coming up those elevators. I love seeing you as the editor in chief. I'm thrilled that you're here. We're going to start this conversation the way we start all of them, which is with a little warmup, some rapid-fire questions. In honor of your new book,, I'm gonna make them entirely running themed. I mean, if your listeners don't wanna hear about running Trail run or track run? Worst running injury you've ever had. The one you wish people would stop talking to you about. You only need to run a 20-miler before a marathon. What do you need to run? Why do people die at mile 20? Because they only train for [marathons] with 20-mile-runs. I generally prefer people, but then you have to schedule it. Backup sport of choice if you could never run again.

Human feedback is central to the alignment of Large Language Models (LLMs).