Goto

Collaborating Authors

 individual branch


Reviews: Knowledge Distillation by On-the-Fly Native Ensemble

Neural Information Processing Systems

Summary: Authors propose a novel multi-branch network with a loss function that uses distillation from a combined branch to distill into individual branches. The technique is motivated by the idea that Teacher-Student knowledge distillation is a two-step process often requiring a large pre-trained teacher. Their method builds a teacher, out of weighted ensemble and uses that to train the network. They are able to show that the combined network (ONE-E) is far superior to standalone networks, and the individual branch (ONE) is also better than its counterpart (i.e if it were trained without any of the loss functions and the branches). Pros: 1. Excellent write-up This is a very well written paper.


Single- and Multi-Agent Private Active Sensing: A Deep Neuroevolution Approach

arXiv.org Artificial Intelligence

The problem of single-agent Evasive AHT (EAHT), Active Hypothesis Testing (AHT) refers to the family of where a passive Eavesdropper (Eve) collects noisy estimates problems where one legitimate agent or decision maker, or a of the legit observations and tries to infer the underlying group of collaborating agents or decision makers, adaptively hypothesis, was studied in [24], focusing however explicitly select(s) sensing actions and collect(s) observations in order on the asymptotical case. In that work, the authors formulated to infer the underlying true hypothesis in a fast and reliable single-agent EAHT as a constrained optimization problem manner [1], [2]. AHT and related problems, such as active including the legitimate agent's and the Eavesdropper's (Eve) parameter estimation [3] and active change point detection [4], error exponent. However, near-optimal or optimal action selection [5], find numerous applications in wireless communications, policies were not presented. In this paper, motivated including anomaly detection over sensor networks [6], strong by the lack of explicit policies for EAHT, we present novel or weak radar models for target detection [7], cyber-intrusion single-and multi-agent EAHT approaches for wireless sensor detection, target search, and adaptive beamforming [8], as well networks that are based on a deep NeuroEvolution (NE) as, very recently, RIS-enabled localization [9] and channel framework. Our contributions are summarized as follows: estimation [10]. In addition, AHT is closely related to the 1) We formulate the single-agent EAHT problem studied feedback channel coding problem [11].