Deep Learning
Taming an autonomous surface vehicle for path following and collision avoidance using deep reinforcement learning
Meyer, Eivind, Robinson, Haakon, Rasheed, Adil, San, Omer
Eivind Meyer is currently working on his Master's thesis, completing his five-year integrated Master's degree in Cybernetics and Robotics at the Norwegian University of Science and Technology (NTNU) in Trondheim. Having specialized in Real Time Systems, his research interests focus on adopting state-of-the-art Artificial Intelligence methods for Autonomous Vehicle Control. Haakon Robinson is a PhD candidate at the Norwegian University of Science and Technology (NTNU). He received a Bachelors degree in Physics in 2015 and completed a Masters degree in Cybernetics and Robotics in 2019, both at NTNU. His current work investigates the overlap between modern machine learning techniques and established methods within modelling and control, with a focus on improving the interpretability and be-E Meyer et al.: Preprint submitted to Elsevier Page 15 of 16 Taming an ASV for path following and collision avoidance using DRL havioural guarantees of hybrid models that combine first principle models and data-driven components.
Open Neural Network Exchange (ONNX) in the enterprise: how Microsoft scales ML - BRK3012
AI, machine learning, deep learning, and advanced analytics are being infused into every team and service at Microsoft--understanding customers and the business, operating services, and delivering innovative new features. But doing machine learning at the scale of Microsoft is challenging. ONNX (open neural network exchange format) has bridged the different model formats for ML frameworks (e.g. Learn how Bing, Ads, Speech, Office, Cognitive Services, and others use frameworks like TensorFlow, PyTorch, Scikit-learn, Caffe for training and rely on ONNX Runtime for high performance inferencing. You'll also learn how to use ONNX and ONNX Runtime in your AI application with Azure ML.
Python for Machine Learning Implementation in Finance
Python is rapidly becoming the world's most popular programming language and its versatility has enabled it to achieve widespread adoption in finance, becoming the multipurpose tool of choice for quantitative analysts and other financial technologists. Join us for this hands-on two day training course led by Harsh Prasad that will provide you with a best practice framework for using Python for machine learning implementation. In-depth sessions will cover all the key elements of Python including classification, clustering, deep learning and natural language processing. Attendees are encouraged to share their specific challenges, discover solutions and network with each other in this open and discussion based learning environment.
Tutorial: Detect objects using deep learning with ONNX and ML.NET - ML.NET
In the Add New Item dialog box, select Class and change the Name field to OnnxModelScorer.cs. Then, select the Add button. The OnnxModelScorer.cs file opens in the code editor. Add the following using statement to the top of OnnxModelScorer.cs: Inside the OnnxModelScorer class definition, add the following variables. Directly below that, create a constructor for the OnnxModelScorer class that will initialize the previously defined variables.
AI experts urge machine learning researchers to tackle climate change
At the Tackling Climate Change workshop at this year's NeurIPS conference, some of the top minds in machine learning came together to discuss the effects of climate change on life on Earth, how AI can tackle the urgent problem, and why and how the machine learning community should join the fight. The panel included Yoshua Bengio, MILA director and University of Montreal professor; Jeff Dean, Google's AI chief; Andrew Ng, cofounder of Google Brain and founder of Landing.ai; and Cornell University professor and Institute for Computational Sustainability director Carla Gomes. The Tackling Climate Change workshop explored a wide range of topics, from the use of deep reinforcement learning to improve performance for ride-hailing services like Uber and Lyft to the application of deep learning to predict wildfire risk, detect avalanche deposits, improve plane efficiency with better wind forecasts, and conduct a global census of solar farms. The workshop is put together by Climate Change AI, a group that hosts workshops at AI research conferences and a forum for collaboration between machine learning practitioners and people from other fields. One essential step in better addressing the world's pressing challenges, says Bengio, is changing the way AI research is valued.
Intel Acquires Israeli Deep-Learning Computing Startup Habana Labs For $2 Billion Technology News
US semiconductor giant Intel has acquired Israeli startup Habana Labs, a developer of artificial intelligence processors, for $2 billion, the company announced on Monday. Founded in 2016, Habana Labs develops processor platforms that are optimized for training deep neural networks and for inference deployment in production environments. The company is headquartered in Tel Aviv and has offices in California, Poland, and China. Intel led a $75 million investment in Habana Labs in 2018. That year, Habana unveiled its Goya inference processor which it says is ideally suited for the most demanding AI applications in the industry, including private and cloud data centers, autonomous vehicles, factory and warehouse automation robots, and high-end drones.
A Comparative Study of Pretrained Language Models on Thai Social Text Categorization
Horsuwan, Thanapapas, Kanwatchara, Kasidis, Vateekul, Peerapon, Kijsirikul, Boonserm
The ever-growing volume of data of user-generated content on social media provides a nearly unlimited corpus of unlabeled data even in languages where resources are scarce. In this paper, we demonstrate that state-of-the-art results on two Thai social text categorization tasks can be realized by pretraining a language model on a large noisy Thai social media corpus of over 1.26 billion tokens and later fine-tuned on the downstream classification tasks. Due to the linguistically noisy and domain-specific nature of the content, our unique data preprocessing steps designed for Thai social media were utilized to ease the training comprehension of the model. We compared four modern language models: ULMFiT, ELMo with biLSTM, OpenAI GPT, and BERT. We systematically compared the models across different dimensions including speed of pretraining and fine-tuning, perplexity, downstream classification benchmarks, and performance in limited pretraining data.
Jointly Trained Image and Video Generation using Residual Vectors
Dandi, Yatin, Das, Aniket, Singhal, Soumye, Namboodiri, Vinay P., Rai, Piyush
In this work, we propose a modeling technique for jointly training image and video generation models by simultaneously learning to map latent variables with a fixed prior onto real images and interpolate over images to generate videos. The proposed approach models the variations in representations using residual vectors encoding the change at each time step over a summary vector for the entire video. W e utilize the technique to jointly train an image generation model with a fixed prior along with a video generation model lacking constraints such as disentanglement. The joint training enables the image generator to exploit temporal information while the video generation model learns to flexibly share information across frames. Moreover, experimental results verify our approach's compatibility with pre-training on videos or images and training on datasets containing a mixture of both. A comprehensive set of quantitative and qualitative evaluations reveal the improvements in sample quality and diversity over both video generation and image generation baselines. W e further demonstrate the technique's capabilities of exploiting similarity in features across frames by applying it to a model based on decomposing the video into motion and content. The proposed model allows minor variations in content across frames while maintaining the temporal dependence through latent vectors encoding the pose or motion features.
Joint Interaction and Trajectory Prediction for Autonomous Driving using Graph Neural Networks
Lee, Donsuk, Gu, Yiming, Hoang, Jerrick, Marchetti-Bowick, Micol
In this work, we aim to predict the future motion of vehicles in a traffic scene by explicitly modeling their pairwise interactions. Specifically, we propose a graph neural network that jointly predicts the discrete interaction modes and 5-second future trajectories for all agents in the scene. Our model infers an interaction graph whose nodes are agents and whose edges capture the long-term interaction intents among the agents. In order to train the model to recognize known modes of interaction, we introduce an auto-labeling function to generate ground truth interaction labels. Using a large-scale real-world driving dataset, we demonstrate that jointly predicting the trajectories along with the explicit interaction types leads to significantly lower trajectory error than baseline methods. Finally, we show through simulation studies that the learned interaction modes are semantically meaningful.
Accelerating PDE-constrained Inverse Solutions with Deep Learning and Reduced Order Models
Sheriffdeen, Sheroze, Ragusa, Jean C., Morel, Jim E., Adams, Marvin L., Bui-Thanh, Tan
Inverse problems are pervasive mathematical methods in inferring knowledge from observational and experimental data by leveraging simulations and models. Unlike direct inference methods, inverse problem approaches typically require many forward model solves usually governed by Partial Differential Equations (PDEs). This a crucial bottleneck in determining the feasibility of such methods. While machine learning (ML) methods, such as deep neural networks (DNNs), can be employed to learn nonlinear forward models, designing a network architecture that preserves accuracy while generalizing to new parameter regimes is a daunting task. Furthermore, due to the computation-expensive nature of forward models, state-of-the-art black-box ML methods would require an unrealistic amount of work in order to obtain an accurate surrogate model. On the other hand, standard Reduced-Order Models (ROMs) accurately capture supposedly important physics of the forward model in the reduced subspaces, but otherwise could be inaccurate elsewhere. In this paper, we propose to enlarge the validity of ROMs and hence improve the accuracy outside the reduced subspaces by incorporating a data-driven ML technique. In particular, we focus on a goal-oriented approach that substantially improves the accuracy of reduced models by learning the error between the forward model and the ROM outputs. Once an ML-enhanced ROM is constructed it can accelerate the performance of solving many-query problems in parametrized forward and inverse problems. Numerical results for inverse problems governed by elliptic PDEs and parametrized neutron transport equations will be presented to support our approach.