Generalisation of a deep neural network (DNN) is one major concern when employing the deep learning approach for solving practical problems. In this paper we propose a new technique, named approximated orthonormal normalisation (AON), to improve the generalisation capacity of a DNN model. Considering a weight matrix W from a particular neural layer in the model, our objective is to design a function h(W) such that its row vectors are approximately orthogonal to each other while allowing the DNN model to fit the training data sufficiently accurate. By doing so, it would avoid co-adaptation among neurons of the same layer to be able to improve network-generalisation capacity. Specifically, at each iteration, we first approximate (WW^T)^(-1/2) using its Taylor expansion before multiplying the matrix W. After that, the matrix product is then normalised by applying the spectral normalisation (SN) technique to obtain h(W). Conceptually speaking, AON is designed to turn orthonormal regularisation into orthonormal normalisation to avoid manual balancing the original and penalty functions. Experimental results show that AON yields promising validation performance compared to orthonormal regularisation.

Uncertainty propagation in nonlinear dynamic systems remains an outstanding problem in scientific computing and control. Numerous approaches have been developed, but are limited in their capability to tackle problems with more than a few uncertain variables or require large amounts of simulation data. In this paper, we propose a data-driven method for approximating joint probability density functions (PDFs) of nonlinear dynamic systems with initial condition and parameter uncertainty. Our approach leverages on the power of deep learning to deal with high-dimensional inputs, but we overcome the need for huge quantities of training data by encoding PDF evolution equations directly into the optimization problem. We demonstrate the potential of the proposed method by applying it to evaluate the robustness of a feedback controller for a six-dimensional rigid body with parameter uncertainty.

Non-autoregressive translation (NAT) models remove the dependence on previous target tokens and generate all target tokens in parallel, resulting in significant inference speedup but at the cost of inferior translation accuracy compared to autoregressive translation (AT) models. Considering that AT models have higher accuracy and are easier to train than NAT models, and both of them share the same model configurations, a natural idea to improve the accuracy of NAT models is to transfer a well-trained AT model to an NAT model through fine-tuning. However, since AT and NAT models differ greatly in training strategy, straightforward fine-tuning does not work well. In this work, we introduce curriculum learning into fine-tuning for NAT. Specifically, we design a curriculum in the fine-tuning process to progressively switch the training from autoregressive generation to non-autoregressive generation. Experiments on four benchmark translation datasets show that the proposed method achieves good improvement (more than $1$ BLEU score) over previous NAT baselines in terms of translation accuracy, and greatly speed up (more than $10$ times) the inference process over AT baselines.

The purpose of this paper is to describe and analyze the development of a knowledge-based infrastructure to support MSP decision-making processes. The paper emerged from a study to define specifications for a knowledge-based infrastructure to provide decision support for community-level MSPs in the Canadian province of Quebec. As part of the study, a process assessment was conducted to understand the needs of communities as they collect, organize, and analyze data to make decisions about their priorities. The result of this process is a portrait, which is an epidemiological profile of health and nutrition in their community. Portraits inform strategic planning and development of interventions and are used to assess the impact of interventions. Our key findings indicate ambiguities and disagreement among MSP decision-makers regarding causal relationships between actions and outcomes, and the relevant data needed for making decisions. MSP decision-makers expressed a desire for easy-to-use tools that facilitate the collection, organization, synthesis, and analysis of data, to enable decision-making in a timely manner. Findings inform conceptual modeling and ontological analysis to capture the domain knowledge and specify relationships between actions and outcomes. This modeling and analysis provide the foundation for an ontology, encoded using OWL 2 Web Ontology Language. The ontology is developed to provide semantic support for the MSP process, defining objectives, strategies, actions, indicators, and data sources. In the future, software interacting with the ontology can facilitate interactive browsing by decision-makers in the MSP in the form of concepts, instances, relationships, and axioms. Our ontology also facilitates the integration and interpretation of community data and can help in managing semantic interoperability between different knowledge sources.

One of the most ambitious use cases of computer-assisted learning is to build a lifelong learning recommendation system. Unlike short-term courses, lifelong learning presents unique challenges, requiring sophisticated recommendation models that account for a wide range of factors such as background knowledge of learners or novelty of the material while effectively maintaining knowledge states of masses of learners for significantly longer periods of time (ideally, a lifetime). This work presents the foundations towards building a dynamic, scalable and transparent recommendation system for education, modelling learner's knowledge from implicit data in the form of engagement with open educational resources. We i) use a text ontology based on Wikipedia to automatically extract knowledge components of educational resources and, ii) propose a set of online Bayesian strategies inspired by the well-known areas of item response theory and knowledge tracing. Our proposal, TrueLearn, focuses on recommendations for which the learner has enough background knowledge (so they are able to understand and learn from the material), and the material has enough novelty that would help the learner improve their knowledge about the subject and keep them engaged. We further construct a large open educational video lectures dataset and test the performance of the proposed algorithms, which show clear promise towards building an effective educational recommendation system. Introduction One-on-one tutoring has shown learning gains of the order of two standard deviations (Corbett 2001). Machine learning now promises to provide such benefits of high quality personalised teaching to anyone in the world in a cost effective manner (Piech et al. 2015). Meanwhile, Open Educational Resources (OERs), defined as teaching, learning and research material available in the public domain or published under an open license (UNESCO 2019), are growing at a very fast pace.

San Diego, Calif., November 14, 2019 -- From companies worth billions of dollars to startups employing a small number of people, UC San Diego engineering alumni are at the core of the robotics ecosystem here in San Diego County. This was clearly evident at the sixth annual robotics forum organized by the UC San Diego Contextual Robotics Institute Nov. 7. The forum focused exclusively on local companies this year and was dubbed the San Diego Robotics Forum for the occasion. The goal was to showcase the breadth and depth of the region's robotics strengths, and solidify San Diego's reputation as Robot Beach. "We have an important mission here to showcase how strong San Diego is in the area of robotics," said Henrik Christensen, director of the UC San Diego Contextual Robotics Institute.

Enterprise firms across the globe are increasingly turning to AI-driven technologies to achieve key business goals. While potential benefits are significant, many firms underestimate the fundamental change necessary to successfully integrate AI into the enterprise. Successful adoption programs need to be developed to fit the particular needs of each organization--from its data strategy, project management, and product development to its engagement with the cloud, customers, and partners. This fall, the Laboratory for Innovation Science (LISH), HBS Digital Initiative, and the Harvard School of Engineering and Applied Sciences (SEAS) will kick off "AI in Enterprise," an invitation-only workshop series for selected executives to learn how to manage expectations and assimilate the knowledge and tools they need to implement a successful transition to AI in the enterprise. The first in the series will focus on AI in finance.

This is a global problem, yet one of the most striking examples is the case of Japan. From 800 until 1900 CE, Japan used a writing system called Kuzushiji, which was removed from the curriculum in 1900 when the elementary school education was reformed. Currently, the overwhelming majority of Japanese speakers cannot read texts which are more than 150 years old. The volume of these texts -- comprised of over three million books in storage but only readable by a handful of specially-trained scholars -- is staggering. One library alone has digitized 20 million pages from such documents.

Cirta is a new machine-learning challenge for high-energy physics on Zindi, the Africa-based data-science challenge platform. Launched this autumn at the International Conference on High Energy and Astroparticle Physics (TIC-HEAP), Constantine, Algeria, Cirta challenges participants to provide machine-learning solutions for identifying particles in LHC experiment data. Cirta* is the first particle-physics challenge to specifically target computer scientists in Africa, and puts the public TrackML challenge dataset to new use. Created by ATLAS computer scientists Sabrina Amrouche and Dalila Salamani, the Cirta challenge aims to bring new blood into the growing field of machine learning for particle physics. "Zindi has a strong community of computer scientists based on the continent, and we're looking forward to reviewing their creative solutions to the challenge," says Salamani.

The need for convergence of people, process and technology in modern business has ignited the evolution of newer engineering methodologies. Artificial Intelligence (AI) is no exception. It demands even greater interaction of human and non-human resources in the production processes. AI solutions are built on the basis of an algorithm, data and the continuous learning process. Constantly growing data has enriched the quality of the knowledge and increased computing power has extended machine learning into deep learning; together, our collective ability to quickly evolve an AI solution has improved.