Goto

Collaborating Authors

 garnet


GARNET: Reduced-Rank Topology Learning for Robust and Scalable Graph Neural Networks

Deng, Chenhui, Li, Xiuyu, Feng, Zhuo, Zhang, Zhiru

arXiv.org Artificial Intelligence

Graph neural networks (GNNs) have been increasingly deployed in various applications that involve learning on non-Euclidean data. However, recent studies show that GNNs are vulnerable to graph adversarial attacks. Although there are several defense methods to improve GNN robustness by eliminating adversarial components, they may also impair the underlying clean graph structure that contributes to GNN training. In addition, few of those defense models can scale to large graphs due to their high computational complexity and memory usage. In this paper, we propose GARNET, a scalable spectral method to boost the adversarial robustness of GNN models. GARNET first leverages weighted spectral embedding to construct a base graph, which is not only resistant to adversarial attacks but also contains critical (clean) graph structure for GNN training. Next, GARNET further refines the base graph by pruning additional uncritical edges based on probabilistic graphical model. GARNET has been evaluated on various datasets, including a large graph with millions of nodes. Our extensive experiment results show that GARNET achieves adversarial accuracy improvement and runtime speedup over state-of-the-art GNN (defense) models by up to 13.27% and 14.7x, respectively.


Machine Learning guided high-throughput search of non-oxide garnets

Schmidt, Jonathan, Wang, Haichen, Schmidt, Georg, Marques, Miguel

arXiv.org Artificial Intelligence

Garnets, known since the early stages of human civilization, have found important applications in modern technologies including magnetorestriction, spintronics, lithium batteries, etc. The overwhelming majority of experimentally known garnets are oxides, while explorations (experimental or theoretical) for the rest of the chemical space have been limited in scope. A key issue is that the garnet structure has a large primitive unit cell, requiring an enormous amount of computational resources. To perform a comprehensive search of the complete chemical space for new garnets,we combine recent progress in graph neural networks with high-throughput calculations. We apply the machine learning model to identify the potential (meta-)stable garnet systems before systematic density-functional calculations to validate the predictions. In this way, we discover more than 600 ternary garnets with distances to the convex hull below 100~meV/atom with a variety of physical and chemical properties. This includes sulfide, nitride and halide garnets. For these, we analyze the electronic structure and discuss the connection between the value of the electronic band gap and charge balance.


Momentum in Reinforcement Learning

Vieillard, Nino, Scherrer, Bruno, Pietquin, Olivier, Geist, Matthieu

arXiv.org Machine Learning

We adapt the optimization's concept of momentum to reinforcement learning. Seeing the state-action value functions as an analog to the gradients in optimization, we interpret momentum as an average of consecutive $q$-functions. We derive Momentum Value Iteration (MoVI), a variation of Value Iteration that incorporates this momentum idea. Our analysis shows that this allows MoVI to average errors over successive iterations. We show that the proposed approach can be readily extended to deep learning. Specifically, we propose a simple improvement on DQN based on MoVI, and experiment it on Atari games.


Watch: NASA Tests InSight Lander Replica In Simulated Martian Conditions

International Business Times

NASA released a 360-degree video showcasing a replica of its InSight Mars Lander being tested in simulated Martian conditions. The two-year-long InSight mission is targeted at penetrating deep into Mars and understanding the red planet's interior. The launch of the lander is still a few months away, but in order to test its ability to work in uncertain Martian conditions, the agency is looking at the replica of the robot on its own version of Mars created at the Jet Propulsion Laboratory in California. NASA scientists used crushed garnet as Martian sand and gravel and specialized light to see how the lander would settle on the uneven surface of the planet and adjust to the color and brightness of sunlight on it while doing all kinds of experiments. As garnet does not produce dust, the agency used piles of the material to check the deployment of lander's critical instruments – a high-precision seismometer for detecting quakes and measuring the planet's internal temperature, a shield isolating the seismometer from wind and temperature changes, and a heat-flow probe that digs up to 5 meters underground to measure the amount of heat escaping from the planet's interior.


Adaptive Bases for Reinforcement Learning

Di Castro, Dotan, Mannor, Shie

arXiv.org Artificial Intelligence

We consider the problem of reinforcement learning using function approximation, where the approximating basis can change dynamically while interacting with the environment. A motivation for such an approach is maximizing the value function fitness to the problem faced. Three errors are considered: approximation square error, Bellman residual, and projected Bellman residual. Algorithms under the actor-critic framework are presented, and shown to converge. The advantage of such an adaptive basis is demonstrated in simulations.