garnet
GARNET: Reduced-Rank Topology Learning for Robust and Scalable Graph Neural Networks
Deng, Chenhui, Li, Xiuyu, Feng, Zhuo, Zhang, Zhiru
Graph neural networks (GNNs) have been increasingly deployed in various applications that involve learning on non-Euclidean data. However, recent studies show that GNNs are vulnerable to graph adversarial attacks. Although there are several defense methods to improve GNN robustness by eliminating adversarial components, they may also impair the underlying clean graph structure that contributes to GNN training. In addition, few of those defense models can scale to large graphs due to their high computational complexity and memory usage. In this paper, we propose GARNET, a scalable spectral method to boost the adversarial robustness of GNN models. GARNET first leverages weighted spectral embedding to construct a base graph, which is not only resistant to adversarial attacks but also contains critical (clean) graph structure for GNN training. Next, GARNET further refines the base graph by pruning additional uncritical edges based on probabilistic graphical model. GARNET has been evaluated on various datasets, including a large graph with millions of nodes. Our extensive experiment results show that GARNET achieves adversarial accuracy improvement and runtime speedup over state-of-the-art GNN (defense) models by up to 13.27% and 14.7x, respectively.
Machine Learning guided high-throughput search of non-oxide garnets
Schmidt, Jonathan, Wang, Haichen, Schmidt, Georg, Marques, Miguel
Garnets, known since the early stages of human civilization, have found important applications in modern technologies including magnetorestriction, spintronics, lithium batteries, etc. The overwhelming majority of experimentally known garnets are oxides, while explorations (experimental or theoretical) for the rest of the chemical space have been limited in scope. A key issue is that the garnet structure has a large primitive unit cell, requiring an enormous amount of computational resources. To perform a comprehensive search of the complete chemical space for new garnets,we combine recent progress in graph neural networks with high-throughput calculations. We apply the machine learning model to identify the potential (meta-)stable garnet systems before systematic density-functional calculations to validate the predictions. In this way, we discover more than 600 ternary garnets with distances to the convex hull below 100~meV/atom with a variety of physical and chemical properties. This includes sulfide, nitride and halide garnets. For these, we analyze the electronic structure and discuss the connection between the value of the electronic band gap and charge balance.
- Materials > Chemicals (0.49)
- Energy > Energy Storage (0.48)
Momentum in Reinforcement Learning
Vieillard, Nino, Scherrer, Bruno, Pietquin, Olivier, Geist, Matthieu
We adapt the optimization's concept of momentum to reinforcement learning. Seeing the state-action value functions as an analog to the gradients in optimization, we interpret momentum as an average of consecutive $q$-functions. We derive Momentum Value Iteration (MoVI), a variation of Value Iteration that incorporates this momentum idea. Our analysis shows that this allows MoVI to average errors over successive iterations. We show that the proposed approach can be readily extended to deep learning. Specifically, we propose a simple improvement on DQN based on MoVI, and experiment it on Atari games.
- North America > United States > Massachusetts > Middlesex County > Belmont (0.04)
- Europe > France > Grand Est > Meurthe-et-Moselle > Nancy (0.04)
Watch: NASA Tests InSight Lander Replica In Simulated Martian Conditions
NASA released a 360-degree video showcasing a replica of its InSight Mars Lander being tested in simulated Martian conditions. The two-year-long InSight mission is targeted at penetrating deep into Mars and understanding the red planet's interior. The launch of the lander is still a few months away, but in order to test its ability to work in uncertain Martian conditions, the agency is looking at the replica of the robot on its own version of Mars created at the Jet Propulsion Laboratory in California. NASA scientists used crushed garnet as Martian sand and gravel and specialized light to see how the lander would settle on the uneven surface of the planet and adjust to the color and brightness of sunlight on it while doing all kinds of experiments. As garnet does not produce dust, the agency used piles of the material to check the deployment of lander's critical instruments – a high-precision seismometer for detecting quakes and measuring the planet's internal temperature, a shield isolating the seismometer from wind and temperature changes, and a heat-flow probe that digs up to 5 meters underground to measure the amount of heat escaping from the planet's interior.
- Government > Space Agency (0.96)
- Government > Regional Government > North America Government > United States Government (0.96)
Adaptive Bases for Reinforcement Learning
Di Castro, Dotan, Mannor, Shie
We consider the problem of reinforcement learning using function approximation, where the approximating basis can change dynamically while interacting with the environment. A motivation for such an approach is maximizing the value function fitness to the problem faced. Three errors are considered: approximation square error, Bellman residual, and projected Bellman residual. Algorithms under the actor-critic framework are presented, and shown to converge. The advantage of such an adaptive basis is demonstrated in simulations.
- North America > United States > Tennessee > Davidson County > Nashville (0.04)
- North America > United States > Massachusetts > Middlesex County > Cambridge (0.04)
- North America > Canada > Alberta (0.04)
- Asia > Middle East > Israel (0.04)