Goto

Collaborating Authors

 Oceania


Boosting the Efficiency of Parametric Detection with Hierarchical Neural Networks

arXiv.org Artificial Intelligence

Gravitational wave astronomy is a vibrant field that leverages both classic and modern data processing techniques for the understanding of the universe. Various approaches have been proposed for improving the efficiency of the detection scheme, with hierarchical matched filtering being an important strategy. Meanwhile, deep learning methods have recently demonstrated both consistency with matched filtering methods and remarkable statistical performance. In this work, we propose Hierarchical Detection Network (HDN), a novel approach to efficient detection that combines ideas from hierarchical matching and deep learning. The network is trained using a novel loss function, which encodes simultaneously the goals of statistical accuracy and efficiency. We discuss the source of complexity reduction of the proposed model, and describe a general recipe for initialization with each layer specializing in different regions. We demonstrate the performance of HDN with experiments using open LIGO data and synthetic injections, and observe with two-layer models a $79\%$ efficiency gain compared with matched filtering at an equal error rate of $0.2\%$. Furthermore, we show how training a three-layer HDN initialized using two-layer model can further boost both accuracy and efficiency, highlighting the power of multiple simple layers in efficient detection.


Composing RNNs and FSTs for Small Data: Recovering Missing Characters in Old Hawaiian Text

arXiv.org Artificial Intelligence

In contrast to the older writing system of the 19th century, modern Hawaiian orthography employs characters for long vowels and glottal stops. These extra characters account for about one-third of the phonemes in Hawaiian, so including them makes a big difference to reading comprehension and pronunciation. However, transliterating between older and newer texts is a laborious task when performed manually. We introduce two related methods to help solve this transliteration problem automatically, given that there were not enough data to train an end-to-end deep learning model. One method is implemented, end-to-end, using finite state transducers (FSTs). The other is a hybrid deep learning approach which approximately composes an FST with a recurrent neural network (RNN). We find that the hybrid approach outperforms the end-to-end FST by partitioning the original problem into one part that can be modelled by hand, using an FST, and into another part, which is easily solved by an RNN trained on the available data.


Experience with Abrupt Transition to Remote Teaching of Embedded Systems

arXiv.org Artificial Intelligence

Due to the pandemic of COVID-19, many university courses had to abruptly transform to enable remote teaching. Adjusting courses on embedded systems and micro-controllers was extra challenging since interaction with real hardware is their integral part. We start by comparing our experience with four basic alternatives of teaching embedded systems: 1) interacting with hardware at school, 2) having remote access to hardware, 3) lending hardware to students for at-home work and 4) virtualizing hardware. Afterward, we evaluate in detail our experience of the fast transition from traditional, offline at-school hardware programming course to using remote access to real hardware present in the lab. The somewhat unusual remote hardware access approach turned out to be a fully viable alternative for teaching embedded systems, enabling a relatively low-effort transition. Our setup is based on existing solutions and stable open technologies without the need for custom-developed applications that require high maintenance. We evaluate the experience of both the students and teachers and condense takeaways for future courses. The specific environment setup is available online as an inspiration for others.


Enhancing Document-level Relation Extraction by Entity Knowledge Injection

arXiv.org Artificial Intelligence

Document-level relation extraction (RE) aims to identify the relations between entities throughout an entire document. It needs complex reasoning skills to synthesize various knowledge such as coreferences and commonsense. Large-scale knowledge graphs (KGs) contain a wealth of real-world facts, and can provide valuable knowledge to document-level RE. In this paper, we propose an entity knowledge injection framework to enhance current document-level RE models. Specifically, we introduce coreference distillation to inject coreference knowledge, endowing an RE model with the more general capability of coreference reasoning. We also employ representation reconciliation to inject factual knowledge and aggregate KG representations and document representations into a unified space.


Intelligent 3D Network Protocol for Multimedia Data Classification using Deep Learning

arXiv.org Artificial Intelligence

In videos, the human's actions are of three-dimensional (3D) signals. These videos investigate the spatiotemporal knowledge of human behavior. The promising ability is investigated using 3D convolution neural networks (CNNs). The 3D CNNs have not yet achieved high output for their well-established two-dimensional (2D) equivalents in still photographs. Board 3D Convolutional Memory and Spatiotemporal fusion face training difficulty preventing 3D CNN from accomplishing remarkable evaluation. In this paper, we implement Hybrid Deep Learning Architecture that combines STIP and 3D CNN features to enhance the performance of 3D videos effectively. After implementation, the more detailed and deeper charting for training in each circle of space-time fusion. The training model further enhances the results after handling complicated evaluations of models. The video classification model is used in this implemented model. Intelligent 3D Network Protocol for Multimedia Data Classification using Deep Learning is introduced to further understand spacetime association in human endeavors. In the implementation of the result, the well-known dataset, i.e., UCF101 to, evaluates the performance of the proposed hybrid technique. The results beat the proposed hybrid technique that substantially beats the initial 3D CNNs. The results are compared with state-of-the-art frameworks from literature for action recognition on UCF101 with an accuracy of 95%.


Top challenge to internet health is AI power disparity and harm, Mozilla says

#artificialintelligence

The top challenge for the health of the internet is the power disparity between who benefits from AI and who is harmed by AI, Mozilla's new 2022 Internet Health reveals. Once again, this new report puts AI under the spotlight for how companies and governments use the technology. Mozilla's report scrutinized the nature of the AI-driven world citing real examples from different countries. TechRepublic spoke to Solana Larsen, Mozilla's Internet Health report editor, to shed light on the concept of "Responsible AI from the Start," black box AI, the future of regulations and how some AI projects lead by example. Larsen explains that AI systems should be built from the start considering ethics and responsibility, not tacked on at a later date when the harms begin to emerge.


Artificial Intelligence and Renewables: The rise of renewables in Australia

#artificialintelligence

What role will machine learning, a subset of AI, play in Australia's transition to a zero carbon energy future, and what are some of the implications and trade-offs that come with its increased use in our energy infrastructure? Over the past decade, renewable energy consumption has grown globally at an average annual rate of 13.7%. In Australia, 2020 saw more than a quarter of the country's total electricity generation coming from renewable sources for the first time. Tasmania, the Australian island state, currently runs on 100% renewable energy. This is good news for climate change.


JSwarm: A Jingulu-Inspired Human-AI-Teaming Language for Context-Aware Swarm Guidance

#artificialintelligence

Bi-directional communication between humans and swarm systems begs for efficient languages to communicate information between the humans and the Artificial Intelligence (AI)-enabled agents in a manner that is most appropriate for the context. We discuss the criteria for effective teaming and functional bi-directional communication between humans and AI, and the design choices required to create effective languages. We then present a human-AI-teaming communication language inspired by the Australian Aboriginal language of Jingulu, which we call JSwarm. We present the motivation and structure of the language. An example is used to demonstrate how the language operates for a shepherding swarm guidance task.


Droneshield To Partner Australian Missile Corporation

#artificialintelligence

DroneShield has announced it has signed a collaboration agreement with The Australian Missile Corporation (AMC), as the $1bn Guided Weapons and Explosive Ordnance (GWEO) enterprise enters the next phase. The AMC was one of the Australian-based GWEO enterprise panel partners invited by the Commonwealth Government in April to work with global missile manufacturing giants Lockheed Martin and Raytheon in establishing a local industry. Considered areas of cooperation between AMC and DroneShield include counterdrone security, prevalent in current battlefield as seen with the Ukraine war, as well as Electronic Warfare and associated Artificial Intelligence work. AMC's CEO, commented "We are pleased to cooperate with DroneShield, with its Australian sovereign capability, as we progress our GWEO program. Its world-leading technologies combined with its expertise in engineering and physics would be critical to the development of guided weapons in Australia."


Transforming Wikipedia into Augmented Data for Query-Focused Summarization

arXiv.org Artificial Intelligence

The limited size of existing query-focused summarization datasets renders training data-driven summarization models challenging. Meanwhile, the manual construction of a query-focused summarization corpus is costly and time-consuming. In this paper, we use Wikipedia to automatically collect a large query-focused summarization dataset (named WIKIREF) of more than 280, 000 examples, which can serve as a means of data augmentation. We also develop a BERT-based query-focused summarization model (Q-BERT) to extract sentences from the documents as summaries. To better adapt a huge model containing millions of parameters to tiny benchmarks, we identify and fine-tune only a sparse subnetwork, which corresponds to a small fraction of the whole model parameters. Experimental results on three DUC benchmarks show that the model pre-trained on WIKIREF has already achieved reasonable performance. After fine-tuning on the specific benchmark datasets, the model with data augmentation outperforms strong comparison systems. Moreover, both our proposed Q-BERT model and subnetwork fine-tuning further improve the model performance. The dataset is publicly available at https://aka.ms/wikiref.