Oceania
Brain startup beats Elon Musk's Neuralink - putting implant into brain of ALS patient in NYC
A 48-year-old patient in New York City who is unable to move and speak due to severe paralysis from ALS became the first to receive a permanent brain implant that could allow him to communicate telepathically - a milestone for Synchron, the startup behind the technology, which beat Elon Musk's Neuralink to the punch with its advance. The procedure took place July 6 at Mount Sinai West medical center in Manhattan, where a 1.5-inch long implant - a brain-computer interface (BCI) as a stentrode - made of wires and electrodes was implanted into the patient's brain without the need for cutting into their skull or damaging tissue. 'The first-in-human implant of an endovascular BCI in the U.S. is a major clinical milestone that opens up new possibilities for patients with paralysis,' said Dr. Tom Oxley, CEO & Founder of Synchron, in a statement. 'The first-in-human implant of an endovascular BCI in the U.S. is a major clinical milestone that opens up new possibilities for patients with paralysis,' said Dr. Tom Oxley, CEO & Founder of Synchron, in a statement. 'Our technology is for the millions of people who have lost the ability to use their hands to control digital devices.
What machine learning and rich historical data mean for fraud protection - retailbiz
Fraud is evolving, and many Australian businesses may struggle to keep up with fraudsters who are continuing to find new ways to evade detection and exploit vulnerabilities. In the twelve months to June 2021 alone, the Australian Payments Network found fraud on payment card transactions totalled $490.1 million, an increase of 9.2 per cent from the year before. Further, research from Statista shows that as of 2021, around 1.25 million dollars had been lost in online shopping scams in Australia. For retailers of all sizes, it has never been more important to get ahead and proactively find a solution that helps to stop fraudulent transactions without turning away legitimate customers and limiting opportunities for growth. What your business needs, however, depends on the size of your organisation or the trajectory of growth that you are on.
Identify rooftop solar panels from satellite imagery using Amazon Rekognition Custom Labels
Renewable resources like sunlight provide a sustainable and carbon neutral mechanism to generate power. Governments in many countries are providing incentives and subsidies to households to install solar panels as part of small-scale renewable energy schemes. This has created a huge demand for solar panels. Reaching out to potential customers at the right time, through the right channel, and with attractive offers is very crucial for solar and energy companies. They're looking for cost-efficient approaches and tools to conduct targeted marketing to proactively reach out to potential customers.
The Caltech Fish Counting Dataset: A Benchmark for Multiple-Object Tracking and Counting
Kay, Justin, Kulits, Peter, Stathatos, Suzanne, Deng, Siqi, Young, Erik, Beery, Sara, Van Horn, Grant, Perona, Pietro
We present the Caltech Fish Counting Dataset (CFC), a large-scale dataset for detecting, tracking, and counting fish in sonar videos. We identify sonar videos as a rich source of data for advancing low signal-to-noise computer vision applications and tackling domain generalization in multiple-object tracking (MOT) and counting. In comparison to existing MOT and counting datasets, which are largely restricted to videos of people and vehicles in cities, CFC is sourced from a natural-world domain where targets are not easily resolvable and appearance features cannot be easily leveraged for target re-identification. With over half a million annotations in over 1,500 videos sourced from seven different sonar cameras, CFC allows researchers to train MOT and counting algorithms and evaluate generalization performance at unseen test locations. We perform extensive baseline experiments and identify key challenges and opportunities for advancing the state of the art in generalization in MOT and counting.
A Convolutional Neural Network Approach to Supernova Time-Series Classification
Qu, Helen, Sako, Masao, Moller, Anais, Doux, Cyrille
One of the brightest objects in the universe, supernovae (SNe) are powerful explosions marking the end of a star's lifetime. Supernova (SN) type is defined by spectroscopic emission lines, but obtaining spectroscopy is often logistically unfeasible. Thus, the ability to identify SNe by type using time-series image data alone is crucial, especially in light of the increasing breadth and depth of upcoming telescopes. We present a convolutional neural network method for fast supernova time-series classification, with observed brightness data smoothed in both the wavelength and time directions with Gaussian process regression. We apply this method to full duration and truncated SN time-series, to simulate retrospective as well as real-time classification performance. Retrospective classification is used to differentiate cosmologically useful Type Ia SNe from other SN types, and this method achieves >99% accuracy on this task. We are also able to differentiate between 6 SN types with 60% accuracy given only two nights of data and 98% accuracy retrospectively.
Bayesian Generational Population-Based Training
Wan, Xingchen, Lu, Cong, Parker-Holder, Jack, Ball, Philip J., Nguyen, Vu, Ru, Binxin, Osborne, Michael A.
Reinforcement learning (RL) offers the potential for training generally capable agents that can interact autonomously in the real world. However, one key limitation is the brittleness of RL algorithms to core hyperparameters and network architecture choice. Furthermore, non-stationarities such as evolving training data and increased agent complexity mean that different hyperparameters and architectures may be optimal at different points of training. This motivates AutoRL, a class of methods seeking to automate these design choices. One prominent class of AutoRL methods is Population-Based Training (PBT), which have led to impressive performance in several large scale settings. In this paper, we introduce two new innovations in PBT-style methods. First, we employ trust-region based Bayesian Optimization, enabling full coverage of the high-dimensional mixed hyperparameter search space. Second, we show that using a generational approach, we can also learn both architectures and hyperparameters jointly on-the-fly in a single training run. Leveraging the new highly parallelizable Brax physics engine, we show that these innovations lead to large performance gains, significantly outperforming the tuned baseline while learning entire configurations on the fly. Code is available at https://github.com/xingchenwan/bgpbt.
FactGraph: Evaluating Factuality in Summarization with Semantic Graph Representations
Ribeiro, Leonardo F. R., Liu, Mengwen, Gurevych, Iryna, Dreyer, Markus, Bansal, Mohit
Despite recent improvements in abstractive summarization, most current approaches generate summaries that are not factually consistent with the source document, severely restricting their trust and usage in real-world applications. Recent works have shown promising improvements in factuality error identification using text or dependency arc entailments; however, they do not consider the entire semantic graph simultaneously. To this end, we propose FactGraph, a method that decomposes the document and the summary into structured meaning representations (MR), which are more suitable for factuality evaluation. MRs describe core semantic concepts and their relations, aggregating the main content in both document and summary in a canonical form, and reducing data sparsity. FactGraph encodes such graphs using a graph encoder augmented with structure-aware adapters to capture interactions among the concepts based on the graph connectivity, along with text representations using an adapter-based text encoder. Experiments on different benchmarks for evaluating factuality show that FactGraph outperforms previous approaches by up to 15%. Furthermore, FactGraph improves performance on identifying content verifiability errors and better captures subsentence-level factual inconsistencies.
Over-the-Air Federated Edge Learning with Hierarchical Clustering
Aygรผn, Ozan, Kazemi, Mohammad, Gรผndรผz, Deniz, Duman, Tolga M.
We examine federated learning (FL) with over-the-air (OTA) aggregation, where mobile users (MUs) aim to reach a consensus on a global model with the help of a parameter server (PS) that aggregates the local gradients. In OTA FL, MUs train their models using local data at every training round and transmit their gradients simultaneously using the same frequency band in an uncoded fashion. Based on the received signal of the superposed gradients, the PS performs a global model update. While the OTA FL has a significantly decreased communication cost, it is susceptible to adverse channel effects and noise. Employing multiple antennas at the receiver side can reduce these effects, yet the path-loss is still a limiting factor for users located far away from the PS. To ameliorate this issue, in this paper, we propose a wireless-based hierarchical FL scheme that uses intermediate servers (ISs) to form clusters at the areas where the MUs are more densely located. Our scheme utilizes OTA cluster aggregations for the communication of the MUs with their corresponding IS, and OTA global aggregations from the ISs to the PS. We present a convergence analysis for the proposed algorithm, and show through numerical evaluations of the derived analytical expressions and experimental results that utilizing ISs results in a faster convergence and a better performance than the OTA FL alone while using less transmit power. We also validate the results on the performance using different number of cluster iterations with different datasets and data distributions. We conclude that the best choice of cluster aggregations depends on the data distribution among the MUs and the clusters.
$\ell_\infty$-Robustness and Beyond: Unleashing Efficient Adversarial Training
Dolatabadi, Hadi M., Erfani, Sarah, Leckie, Christopher
Neural networks are vulnerable to adversarial attacks: adding well-crafted, imperceptible perturbations to their input can modify their output. Adversarial training is one of the most effective approaches in training robust models against such attacks. However, it is much slower than vanilla training of neural networks since it needs to construct adversarial examples for the entire training data at every iteration, hampering its effectiveness. Recently, Fast Adversarial Training (FAT) was proposed that can obtain robust models efficiently. However, the reasons behind its success are not fully understood, and more importantly, it can only train robust models for $\ell_\infty$-bounded attacks as it uses FGSM during training. In this paper, by leveraging the theory of coreset selection, we show how selecting a small subset of training data provides a general, more principled approach toward reducing the time complexity of robust training. Unlike existing methods, our approach can be adapted to a wide variety of training objectives, including TRADES, $\ell_p$-PGD, and Perceptual Adversarial Training (PAT). Our experimental results indicate that our approach speeds up adversarial training by 2-3 times while experiencing a slight reduction in the clean and robust accuracy.
Target-Driven Structured Transformer Planner for Vision-Language Navigation
Zhao, Yusheng, Chen, Jinyu, Gao, Chen, Wang, Wenguan, Yang, Lirong, Ren, Haibing, Xia, Huaxia, Liu, Si
Vision-language navigation is the task of directing an embodied agent to navigate in 3D scenes with natural language instructions. For the agent, inferring the long-term navigation target from visual-linguistic clues is crucial for reliable path planning, which, however, has rarely been studied before in literature. In this article, we propose a Target-Driven Structured Transformer Planner (TD-STP) for long-horizon goal-guided and room layout-aware navigation. Specifically, we devise an Imaginary Scene Tokenization mechanism for explicit estimation of the long-term target (even located in unexplored environments). In addition, we design a Structured Transformer Planner which elegantly incorporates the explored room layout into a neural attention architecture for structured and global planning. Experimental results demonstrate that our TD-STP substantially improves previous best methods' success rate by 2% and 5% on the test set of R2R and REVERIE benchmarks, respectively. Our code is available at https://github.com/YushengZhao/TD-STP .