Overview
Staff Data Scientist - Risk Simulation
One Concern is a Menlo Park-based benevolent artificial intelligence company with a mission to increase the global community's resilience to natural hazards. Founded at Stanford University, One Concern enables cities, corporations, and citizens to embrace a disaster-free future through AI-enabled technology, policy, and finance. By combining data science and natural phenomena science we are pursuing a vision for planetary-scale resilience, where everyone lives in a safe, equitable, and sustainable world. One Concern is growing rapidly and we are looking for a passionate and motivated Staff Data Scientist for Risk Simulation to join our team. What you will do Build a global-scale resilience model to predict the societal and economic impact and recovery of the built environment against disasters Work with and support domain experts and data scientists in different hazard products Work with a group of data scientists to develop a risk simulation platform Demonstrate up-to-date modeling techniques and apply this to the development, execution, and improvement of action plans Assess the potential usefulness and validity of new statistical approaches and data sources.
Four Deep Learning Papers to Read in June 2021
Welcome to the June edition of the ‚Machine-Learning-Collage' series, where I provide an overview of the different Deep Learning research streams. So what is a ML collage? Simply put, I draft one-slide visual summaries of one of my favourite recent papers. At the end of the month all of the resulting visual collages are collected in a summary blog post. Thereby, I hope to give you a visual and intuitive deep dive into some of the coolest trends. May has been quite the month including the virtual ICLR 2021 conference, ICML review decisions as well as the NeurIPS deadlines.
Conversational Question Answering: A Survey
Question answering (QA) systems provide a way of querying the information available in various formats including, but not limited to, unstructured and structured data in natural languages. It constitutes a considerable part of conversational artificial intelligence (AI) which has led to the introduction of a special research topic on Conversational Question Answering (CQA), wherein a system is required to understand the given context and then engages in multi-turn QA to satisfy the user's information needs. Whilst the focus of most of the existing research work is subjected to single-turn QA, the field of multi-turn QA has recently grasped attention and prominence owing to the availability of large-scale, multi-turn QA datasets and the development of pre-trained language models. With a good amount of models and research papers adding to the literature every year recently, there is a dire need of arranging and presenting the related work in a unified manner to streamline future research. This survey, therefore, is an effort to present a comprehensive review of the state-of-the-art research trends of CQA primarily based on reviewed papers from 2016-2021.
Translating Artificial Intelligence into Clinical Practice
This event is part of the Demystifying regulation and commercialisation mini-series, hosted through the Christabel Pankhurst Institute for Health Technology Research and Innovation. These events, taking place in June and July 2021, are organised by Advanced Materials in Medicine (AMM), Translation Manchester, Digital Futures, the University of Manchester Innovation Factory, and the Institute of Data Science and AI. Significant AI health technology activity is taking place in the Greater Manchester (GM) region across academic institutions, regional government, SMEs and larger organisations. Examples include the development of the Greater Manchester Care Records (GMCR), which integrates primary, secondary and social care data from 2.8M individuals and the recent establishment of the Christabel Pankhurst Institute for Health Technology Research and Innovation (Pankhurst), a cross-sector multi-partner translational enabler; and the European Regional Development Funded Greater Manchester Research and Innovation Health Accelerator to support regional SMEs. Due to these developments, there is increasing awareness of the emerging evidence requirements to demonstrate the utility of AI-based health technology but less detailed understanding of the specifics of this complex and evolving environment.
Be Considerate: Objectives, Side Effects, and Deciding How to Act
Alamdari, Parand Alizadeh, Klassen, Toryn Q., Icarte, Rodrigo Toro, McIlraith, Sheila A.
Recent work in AI safety has highlighted that in sequential decision making, objectives are often underspecified or incomplete. This gives discretion to the acting agent to realize the stated objective in ways that may result in undesirable outcomes. We contend that to learn to act safely, a reinforcement learning (RL) agent should include contemplation of the impact of its actions on the wellbeing and agency of others in the environment, including other acting agents and reactive processes. We endow RL agents with the ability to contemplate such impact by augmenting their reward based on expectation of future return by others in the environment, providing different criteria for characterizing impact. We further endow these agents with the ability to differentially factor this impact into their decision making, manifesting behavior that ranges from self-centred to self-less, as demonstrated by experiments in gridworld environments.
Distributional Sliced Embedding Discrepancy for Incomparable Distributions
Alaya, Mokhtar Z., Gasso, Gilles, Berar, Maxime, Rakotomamonjy, Alain
Gromov-Wasserstein (GW) distance is a key tool for manifold learning and cross-domain learning, allowing the comparison of distributions that do not live in the same metric space. Because of its high computational complexity, several approximate GW distances have been proposed based on entropy regularization or on slicing, and one-dimensional GW computation. In this paper, we propose a novel approach for comparing two incomparable distributions, that hinges on the idea of distributional slicing, embeddings, and on computing the closed-form Wasserstein distance between the sliced distributions. We provide a theoretical analysis of this new divergence, called distributional sliced embedding (DSE) discrepancy, and we show that it preserves several interesting properties of GW distance including rotation-invariance. We show that the embeddings involved in DSE can be efficiently learned. Finally, we provide a large set of experiments illustrating the behavior of DSE as a divergence in the context of generative modeling and in query framework.
Statistical embedding: Beyond principal components
Tjøstheim, Dag, Jullum, Martin, Løland, Anders
There has been an intense recent activity in embedding of very high dimensional and nonlinear data structures, much of it in the data science and machine learning literature. We survey this activity in four parts. In the first part we cover nonlinear methods such as principal curves, multidimensional scaling, local linear methods, ISOMAP, graph based methods and kernel based methods. The second part is concerned with topological embedding methods, in particular mapping topological properties into persistence diagrams. Another type of data sets with a tremendous growth is very high-dimensional network data. The task considered in part three is how to embed such data in a vector space of moderate dimension to make the data amenable to traditional techniques such as cluster and classification techniques. The final part of the survey deals with embedding in $\mathbb{R}^2$, which is visualization. Three methods are presented: $t$-SNE, UMAP and LargeVis based on methods in parts one, two and three, respectively. The methods are illustrated and compared on two simulated data sets; one consisting of a triple of noisy Ranunculoid curves, and one consisting of networks of increasing complexity and with two types of nodes.
Learning and Executing Re-usable Behaviour Trees from Natural Language Instruction
Suddrey, Gavin, Talbot, Ben, Maire, Frederic
Domestic and service robots have the potential to transform industries such as health care and small-scale manufacturing, as well as the homes in which we live. However, due to the overwhelming variety of tasks these robots will be expected to complete, providing generic out-of-the-box solutions that meet the needs of every possible user is clearly intractable. To address this problem, robots must therefore not only be capable of learning how to complete novel tasks at run-time, but the solutions to these tasks must also be informed by the needs of the user. In this paper we demonstrate how behaviour trees, a well established control architecture in the fields of gaming and robotics, can be used in conjunction with natural language instruction to provide a robust and modular control architecture for instructing autonomous agents to learn and perform novel complex tasks. We also show how behaviour trees generated using our approach can be generalised to novel scenarios, and can be re-used in future learning episodes to create increasingly complex behaviours. We validate this work against an existing corpus of natural language instructions, demonstrate the application of our approach on both a simulated robot solving a toy problem, as well as two distinct real-world robot platforms which, respectively, complete a block sorting scenario, and a patrol scenario.
Attention mechanisms and deep learning for machine vision: A survey of the state of the art
Hafiz, Abdul Mueed, Parah, Shabir Ahmad, Bhat, Rouf Ul Alam
With the advent of state of the art nature-inspired pure attention based models i.e. transformers, and their success in natural language processing (NLP), their extension to machine vision (MV) tasks was inevitable and much felt. Subsequently, vision transformers (ViTs) were introduced which are giving quite a challenge to the established deep learning based machine vision techniques. However, pure attention based models/architectures like transformers require huge data, large training times and large computational resources. Some recent works suggest that combinations of these two varied fields can prove to build systems which have the advantages of both these fields. Accordingly, this state of the art survey paper is introduced which hopefully will help readers get useful information about this interesting and potential research area. A gentle introduction to attention mechanisms is given, followed by a discussion of the popular attention based deep architectures. Subsequently, the major categories of the intersection of attention mechanisms and deep learning for machine vision (MV) based are discussed. Afterwards, the major algorithms, issues and trends within the scope of the paper are discussed.
Data-Driven Design-by-Analogy: State of the Art and Future Directions
Jiang, Shuo, Hu, Jie, Wood, Kristin L., Luo, Jianxi
Design-by-Analogy (DbA) is a design methodology, wherein new solutions are generated in a target domain based on inspiration drawn from a source domain through cross-domain analogical reasoning [1, 2, 3]. DbA is an active research area in engineering design and various methods and tools have been proposed to support the implement of its process [4, 5, 6, 7, 8]. Studies have shown that DbA can help designers mitigate design fixation [9] and improve design ideation outcomes [10]. Fig.1 presents an example of DbA applications [11]. This case aims to solve an engineering design problem: How might we rectify the loud sonic boom generated when trains travel at high speeds through tunnels in atmospheric conditions [11, 12]? For potential design solutions to this problem, engineers explored structures in other design fields than trains or in the nature that effectively "break" the sonic-boom effect. When looking into the nature, engineers discovered that kingfisher birds could slice through the air and dive into the water at extremely high speeds to catch prey while barely making a splash. By analogy, engineers re-designed the train's front-end nose to mimic the geometry of the kingfisher's beak. This analogical design reduced noise and eliminated tunnel booms.