Oceania
Neural Bipartite Matching
Graph neural networks (GNNs) have found application Performing the reasoning is achieved via neural execution, for learning in the space of algorithms. in a similar fashion to Veličković et al. (2020). GNNs have However, the algorithms chosen by existing research been both empirically (Veličković et al., 2020) and theoretically (sorting, Breadth-First search, shortest path (Xu et al., 2020) shown to be applicable to algorithmic finding, etc.) usually align perfectly with a standard tasks on graphs, strongly generalising on inputs of sizes GNN architecture. This report describes much larger than trained on. However, these algorithms how neural execution is applied to a complex algorithm, rely on a locally contained and fixed dataflow which aligns such as finding maximum bipartite matching perfectly with a standard GNN architecture, making them by reducing it to a flow problem and using easy to model with GNNs (c.f.
Quantifying the Effects of Prosody Modulation on User Engagement and Satisfaction in Conversational Systems
Choi, Jason Ingyu, Agichtein, Eugene
As voice-based assistants such as Alexa, Siri, and Google Assistant become ubiquitous, users increasingly expect to maintain natural and informative conversations with such systems. However, for an open-domain conversational system to be coherent and engaging, it must be able to maintain the user's interest for extended periods, without sounding boring or annoying. In this paper, we investigate one natural approach to this problem, of modulating response prosody, i.e., changing the pitch and cadence of the response to indicate delight, sadness or other common emotions, as well as using pre-recorded interjections. Intuitively, this approach should improve the naturalness of the conversation, but attempts to quantify the effects of prosodic modulation on user satisfaction and engagement remain challenging. To accomplish this, we report results obtained from a large-scale empirical study that measures the effects of prosodic modulation on user behavior and engagement across multiple conversation domains, both immediately after each turn, and at the overall conversation level. Our results indicate that the prosody modulation significantly increases both immediate and overall user satisfaction. However, since the effects vary across different domains, we verify that prosody modulations do not substitute for coherent, informative content of the responses. Together, our results provide useful tools and insights for improving the naturalness of responses in conversational systems.
Mind Blowing Tech in Learning: AI, VR, and AR featuring Prof. Donald Clark @DonaldClark
Hoy traemos a este espacio esta conferencia titulada "Mind Blowing Tech in Learning: AI, VR, and AR featuring" del Prof. Donald Clark, del Center for Online Innovation in Learning y que nos presentan así: Artificial intelligence (AI) is now the most potent force in IT and will shape learning technology, allowing us to escape from the 30 year paradigm of flat, linear e-learning. During this COIL Fischer Speaker Series presentation, Professor Donald Clark debunks some myths about AI and provide real examples of AI used now in content creation, feedback, assessment and spaced practice. In addition he will talk about virtual reality (VR) & augmented reality (AR) as reviving'learning by doing' and their power to democratize experience. Donald Clark is an EdTech entrepreneur and was CEO and one of the original founders of Epic Group plc, which established itself as the leading company in the UK online learning market, floated on the Stock Market in 1996 and sold in 2005, now CEO of Wildfire Ltd. he also invests in, and advises, EdTech companies. Describing himself as'free from the tyranny of employment', he is a board member of Cogbooks, LearningPool, WildFire and Deputy Chair of Brighton Dome & Arts Festival as well as a Visiting Professor at The University of Derby and Fellow of the Royal Society of Arts (FRSA).
AI Startup Combines Mouse Neurons With Silicon Chips To Make Computers Smarter, Faster
There aren't many computer chips that you have to build a life support system for. You actually need to supply everything they would normally get in a fully biological body. As Hon Weng Chong, the CEO of Australia's Cortical Labs explains, it's all about creating computer systems that learn -- and that learn faster with less training data. That requires a different approach than standard Intel, Nvidia, or AMD chips, he says. "What we've actually built is a hybrid chip that is comprised of a CMOS sensor, so it's a silicon chip with a very fine mesh of electrodes. They're about 17 microns in pitch and there are about 22,000 of them," Chong told me on The AI Show recently.
Acme: A Research Framework for Distributed Reinforcement Learning
Hoffman, Matt, Shahriari, Bobak, Aslanides, John, Barth-Maron, Gabriel, Behbahani, Feryal, Norman, Tamara, Abdolmaleki, Abbas, Cassirer, Albin, Yang, Fan, Baumli, Kate, Henderson, Sarah, Novikov, Alex, Colmenarejo, Sergio Gómez, Cabi, Serkan, Gulcehre, Caglar, Paine, Tom Le, Cowie, Andrew, Wang, Ziyu, Piot, Bilal, de Freitas, Nando
Deep reinforcement learning has led to many recent-and groundbreaking-advancements. However, these advances have often come at the cost of both the scale and complexity of the underlying RL algorithms. Increases in complexity have in turn made it more difficult for researchers to reproduce published RL algorithms or rapidly prototype ideas. To address this, we introduce Acme, a tool to simplify the development of novel RL algorithms that is specifically designed to enable simple agent implementations that can be run at various scales of execution. Our aim is also to make the results of various RL algorithms developed in academia and industrial labs easier to reproduce and extend. To this end we are releasing baseline implementations of various algorithms, created using our framework. In this work we introduce the major design decisions behind Acme and show how these are used to construct these baselines. We also experiment with these agents at different scales of both complexity and computation-including distributed versions. Ultimately, we show that the design decisions behind Acme lead to agents that can be scaled both up and down and that, for the most part, greater levels of parallelization result in agents with equivalent performance, just faster.
A Comprehensive Survey of Neural Architecture Search: Challenges and Solutions
Ren, Pengzhen, Xiao, Yun, Chang, Xiaojun, Huang, Po-Yao, Li, Zhihui, Chen, Xiaojiang, Wang, Xin
Deep learning has made major breakthroughs and progress in many fields. This is due to the powerful automatic representation capabilities of deep learning. It has been proved that the design of the network architecture is crucial to the feature representation of data and the final performance. In order to obtain a good feature representation of data, the researchers designed various complex network architectures. However, the design of the network architecture relies heavily on the researchers' prior knowledge and experience. Therefore, a natural idea is to reduce human intervention as much as possible and let the algorithm automatically design the architecture of the network. Thus going further to the strong intelligence. In recent years, a large number of related algorithms for \textit{Neural Architecture Search} (NAS) have emerged. They have made various improvements to the NAS algorithm, and the related research work is complicated and rich. In order to reduce the difficulty for beginners to conduct NAS-related research, a comprehensive and systematic survey on the NAS is essential. Previously related surveys began to classify existing work mainly from the basic components of NAS: search space, search strategy and evaluation strategy. This classification method is more intuitive, but it is difficult for readers to grasp the challenges and the landmark work in the middle. Therefore, in this survey, we provide a new perspective: starting with an overview of the characteristics of the earliest NAS algorithms, summarizing the problems in these early NAS algorithms, and then giving solutions for subsequent related research work. In addition, we conducted a detailed and comprehensive analysis, comparison and summary of these works. Finally, we give possible future research directions.
Concept Matching for Low-Resource Classification
Errica, Federico, Denoyer, Ludovic, Edizel, Bora, Petroni, Fabio, Plachouras, Vassilis, Silvestri, Fabrizio, Riedel, Sebastian
We propose a model to tackle classification tasks in the presence of very little training data. To this aim, we approximate the notion of exact match with a theoretically sound mechanism that computes a probability of matching in the input space. Importantly, the model learns to focus on elements of the input that are relevant for the task at hand; by leveraging highlighted portions of the training data, an error boosting technique guides the learning process. In practice, it increases the error associated with relevant parts of the input by a given factor. Remarkable results on text classification tasks confirm the benefits of the proposed approach in both balanced and unbalanced cases, thus being of practical use when labeling new examples is expensive. In addition, by inspecting its weights, it is often possible to gather insights on what the model has learned.
Adversarial Attacks on Reinforcement Learning based Energy Management Systems of Extended Range Electric Delivery Vehicles
Wang, Pengyue, Li, Yan, Shekhar, Shashi, Northrop, William F.
Adversarial examples are firstly investigated in the area of computer vision: by adding some carefully designed ''noise'' to the original input image, the perturbed image that cannot be distinguished from the original one by human, can fool a well-trained classifier easily. In recent years, researchers also demonstrated that adversarial examples can mislead deep reinforcement learning (DRL) agents on playing video games using image inputs with similar methods. However, although DRL has been more and more popular in the area of intelligent transportation systems, there is little research investigating the impacts of adversarial attacks on them, especially for algorithms that do not take images as inputs. In this work, we investigated several fast methods to generate adversarial examples to significantly degrade the performance of a well-trained DRL- based energy management system of an extended range electric delivery vehicle. The perturbed inputs are low-dimensional state representations and close to the original inputs quantified by different kinds of norms. Our work shows that, to apply DRL agents on real-world transportation systems, adversarial examples in the form of cyber-attack should be considered carefully, especially for applications that may lead to serious safety issues.
Covid-19 Is History's Biggest Translation Challenge
You, a person who's currently on the English-speaking internet in The Year of The Pandemic, have definitely seen public service information about Covid-19. You've probably been unable to escape seeing quite a lot of it, both online and offline, from handwashing posters to social distancing tape to instructional videos for face covering. But if we want to avoid a pandemic spreading to all the humans in the world, this information also has to reach all the humans of the world--and that means translating Covid PSAs into as many languages as possible, in ways that are accurate and culturally appropriate. It's easy to overlook how important language is for health if you're on the English-speaking internet, where "is this headache actually something to worry about?" is only a quick Wikipedia article or WebMD search away. For over half of the world's population, people can't expect to Google their symptoms, nor even necessarily get a pamphlet from their doctor explaining their diagnosis, because it's not available in a language they can understand.
Quasi-conformal Geometry based Local Deformation Analysis of Lateral Cephalogram for Childhood OSA Classification
Chan, Hei-Long, Yuen, Hoi-Man, Au, Chun-Ting, Chan, Kate Ching-Ching, Li, Albert Martin, Lui, Lok-Ming
Craniofacial profile is one of the anatomical causes of obstructive sleep apnea(OSA). By medical research, cephalometry provides information on patients' skeletal structures and soft tissues. In this work, a novel approach to cephalometric analysis using quasi-conformal geometry based local deformation information was proposed for OSA classification. Our study was a retrospective analysis based on 60 case-control pairs with accessible lateral cephalometry and polysomnography (PSG) data. By using the quasi-conformal geometry to study the local deformation around 15 landmark points, and combining the results with three linear distances between landmark points, a total of 1218 information features were obtained per subject. A L2 norm based classification model was built. Under experiments, our proposed model achieves 92.5% testing accuracy.