Energy
Gauging Variational Inference
Sung-Soo Ahn, Michael Chertkov, Jinwoo Shin
Both provide lower bounds for the partition function by utilizing the so-called gauge transformation which modifies factors of GM while keeping the partition function invariant. Moreover, we prove that both G-MF and G-BP are exact for GMs with a single loop of a special structure, even though the bare MF and BP perform badly in this case.
The Download: Trump's golden dome, and fueling AI with nuclear power
Within a week of his inauguration, President Trump issued an executive order to develop "The Iron Dome for America" (rebranded the "Golden Dome" a month later.) The eruption of a revived conflict between Israel and Iran in June has only strengthened the case for an American version of the Iron Dome in the eyes of the administration. Trump has often expressed admiration for Israel's Iron Dome, an air defense system that can intercept short-range rockets and artillery over the small nation and that is funded in part by the United States. But in the complicated security landscape confronting the world today, is spectacle the same as safety? This story is from our forthcoming print issue, which is all about security.
Bio-Inspired Artificial Neural Networks based on Predictive Coding
Casnici, Davide, Frenkel, Charlotte, Dauwels, Justin
Backpropagation (BP) of errors is the backbone training algorithm for artificial neural networks (ANNs). It updates network weights through gradient descent to minimize a loss function representing the mismatch between predictions and desired outputs. BP uses the chain rule to propagate the loss gradient backward through the network hierarchy, allowing efficient weight updates. However, this process requires weight updates at every layer to rely on a global error signal generated at the network's output. In contrast, the Hebbian model of synaptic plasticity states that weight updates are local, depending only on the activity of pre- and post-synaptic neurons. This suggests biological brains likely do not implement BP directly. Recently, Predictive Coding (PC) has gained interest as a biologically plausible alternative that updates weights using only local information. Originating from 1950s work on signal compression, PC was later proposed as a model of the visual cortex and formalized under the free energy principle, linking it to Bayesian inference and dynamical systems. PC weight updates rely solely on local information and provide theoretical advantages such as automatic scaling of gradients based on uncertainty. This lecture notes column offers a novel, tutorial-style introduction to PC, focusing on its formulation, derivation, and connections to well-known optimization and signal processing algorithms such as BP and the Kalman Filter (KF). It aims to support existing literature by guiding readers from the mathematical foundations of PC to practical implementation, including Python examples using PyTorch.
Flow Battery Manifold Design with Heterogeneous Inputs Through Generative Adversarial Neural Networks
Seng, Eric, O'Connor, Hugh, Boyce, Adam, Bailey, Josh J., van Beek, Anton
Generative machine learning has emerged as a powerful tool for design representation and exploration. However, its application is often constrained by the need for large datasets of existing designs and the lack of interpretability about what features drive optimality. To address these challenges, we introduce a systematic framework for constructing training datasets tailored to generative models and demonstrate how these models can be leveraged for interpretable design. The novelty of this work is twofold: (i) we present a systematic framework for generating archetypes with internally homogeneous but mutually heterogeneous inputs that can be used to generate a training dataset, and (ii) we show how integrating generative models with Bayesian optimization can enhance the interpretability of the latent space of admissible designs. These findings are validated by using the framework to design a flow battery manifold, demonstrating that it effectively captures the space of feasible designs, including novel configurations while enabling efficient exploration. This work broadens the applicability of generative machine-learning models in system designs by enhancing quality and reliability.