Goto

Collaborating Authors

 Deep Learning


Optimizing Neural Network for Computer Vision task in Edge Device

arXiv.org Artificial Intelligence

With the rise of Artificial intelligence, it is realized that deep-learning-based approaches give satisfactory results compared to numerous other state-of-the-art schemes which are hand-engineered to all the computer vision tasks. The features learned from Convolutional neural networks outperform other hand-engineered feature-based methods like SIFT [Mikolajczyk and Schmid (2004)] and HoG [Dalal and Triggs (2005)] in computer vision tasks like image classification and object detection. The availability of large datasets and powerful computation devices made it possible to train the large and complex neural networks to obtain the desired performance on many computer vision tasks. The large amount of open-source pre-trained models trained on large datasets like ImageNet [Challenge], MS-COCO [Lin et al. (2014)], SHVN [Netzer et al. (2011)] created a large number of useful filters especially the features learned from the initial layer helps in transfer learning a lot. In transfer learning, most of the time only the last few layers of pre-trained models are modified and trained which counters the problem of having fewer data to a certain extent. Currently, a variety of embedded systems are deployed but the usage of neural networks is limited in edge devices like microcontrollers, Raspberry Pi. Household devices like Refrigerators, washing machines use a set of logic, rules for their automatic operations. By optimizing the network trained on a dataset traditional way of controlling can be replaced by intelligently monitoring the systems with the power of AI and neural networks [Ranjith M S and Parameshwara (2020)]. Optimizing the convolutional neural network architectures like ResNet [ He et al. (2016)], DenseNet [ Huang et al. (2017)], AlexNet [ Krizhevsky et al. (2012)] which are generally used in computer vision tasks allows creating many useful applications.


Seeking Visual Discomfort: Curiosity-driven Representations for Reinforcement Learning

arXiv.org Artificial Intelligence

Vision-based reinforcement learning (RL) is a promising approach to solve control tasks involving images as the main observation. State-of-the-art RL algorithms still struggle in terms of sample efficiency, especially when using image observations. This has led to increased attention on integrating state representation learning (SRL) techniques into the RL pipeline. Work in this field demonstrates a substantial improvement in sample efficiency among other benefits. However, to take full advantage of this paradigm, the quality of samples used for training plays a crucial role. More importantly, the diversity of these samples could affect the sample efficiency of vision-based RL, but also its generalization capability. In this work, we present an approach to improve sample diversity for state representation learning. Our method enhances the exploration capability of RL algorithms, by taking advantage of the SRL setup. Our experiments show that our proposed approach boosts the visitation of problematic states, improves the learned state representation, and outperforms the baselines for all tested environments. These results are most apparent for environments where the baseline methods struggle. Even in simple environments, our method stabilizes the training, reduces the reward variance, and promotes sample efficiency.


SurvTRACE: Transformers for Survival Analysis with Competing Events

arXiv.org Machine Learning

In medicine, survival analysis studies the time duration to events of interest such as mortality. One major challenge is how to deal with multiple competing events (e.g., multiple disease diagnoses). In this work, we propose a transformer-based model that does not make the assumption for the underlying survival distribution and is capable of handling competing events, namely SurvTRACE. We account for the implicit \emph{confounders} in the observational setting in multi-events scenarios, which causes selection bias as the predicted survival probability is influenced by irrelevant factors. To sufficiently utilize the survival data to train transformers from scratch, multiple auxiliary tasks are designed for multi-task learning. The model hence learns a strong shared representation from all these tasks and in turn serves for better survival analysis. We further demonstrate how to inspect the covariate relevance and importance through interpretable attention mechanisms of SurvTRACE, which suffices to great potential in enhancing clinical trial design and new treatment development. Experiments on METABRIC, SUPPORT, and SEER data with 470k patients validate the all-around superiority of our method.


How to mine dark data with machine learning and AI

#artificialintelligence

Dark data is different in each industry. "Classic" dark data, while captured and stored, is never analyzed. It comprises everything from log files, company documents and emails to social media sentiment, webpages, tables, figures and images. Increasingly, companies are deploying sophisticated technologies to process this data to gain valuable business insights and drive systems automation with deep learning algorithms. Companies apply the three components that comprise machine learning: models, training data and hardware.


DeepMind AI Can Accurately Predict if it Will Rain in Next 90 Minutes

#artificialintelligence

The study found the artificial intelligence could predict rain from five to 90 minutes in advance. Artificial intelligence (AI) programmed by researchers at Alphabet subsidiary DeepMind and the U.K.'s Meteorological Office (Met Office) can forecast extremely short-term rainfall more accurately than current models. The researchers trained a neural network on weather radar data from 2016 to 2018 and tested it using data from 2019. The resulting model can make forecasts over areas measuring up to 1,536 kilometers (954 miles) by 1,280 kilometers (795 miles), and predict the chance of rain in a given 1-kilometer (0.6-mile) by 1-kilometer (0.6-mile) area from five to 90 minutes ahead. DeepMind said the AI model was ranked first for accuracy in 89% of experiments in a blind study of 50 Met Office meteorologists.


OpenAI Unveils A Model Capable of Summarizing Books of Any Length

#artificialintelligence

OpenAI is an artificial intelligence research and development company with a mission to ensure that AI benefits all humanity. OpenAI has come with a new model to examine the alignment problem of machine learning. The interesting thing is that OpenAI's machine learning model summarizes books of any length by just summaries of each chapter to obtain a higher-level overview. The research has been conducted as an empirical study on scaling correspondence issues that can be tricky for AI algorithms. As they require complex input numbers or text that is not at all trained.


Teaching AI to Classify Time-series Patterns with Synthetic Data - KDnuggets

#artificialintelligence

However, we don't want to do a ton of feature engineering or learn complicated time-series algorithms (e.g. We just want to feed our time-series data (with proper labels) into some kind of supervised'learning' machine that can learn these categories (high or low variance, too few or too many anomalies, etc.) from the raw data. Why don't we take advantage of a Python library which can do this kind of classification for us automatically and all we have to do is to throw the data into it using standard Numpy/Pandas format? Even better if that library has the looks and feels of our favorite Scikit-learn package! We find such features in the beautiful library -- tslearn.


Apple's no-code Trinity AI platform handles complex spatial datasets

#artificialintelligence

The Transform Technology Summits start October 13th with Low-Code/No Code: Enabling Enterprise Agility. Apple has been slowly but surely creating a name for itself in the low-code/no-code movement. This July, the Cupertino-based company announced the launch of Trinity AI, a no-code platform for complex spatial datasets. Trinity enables machine learning researchers and non-AI devs to tailor complex spatiotemporal datasets to fit deep learning models. Back in 2019, Apple revealed SwiftUI, a programming language that required much less coding than the Swift language.


A New AI Lexicon: Monopolization

#artificialintelligence

Regulators in the EU and US have recently drawn attention to the market power and monopolistic behavior of big tech firms. Lawmakers in the EU argue that'traditional businesses are increasingly dependent on a limited number of large online platforms' and that these'gatekeepers' leverage their privileged position to stifle competition and enter new markets at a rapid pace (EPRS 2020). Striking a similar tone, lawmakers in the US claim that these companies have'abused their dominant positions, setting and often dictating prices and rules for commerce, search, advertising, social networking and publishing' (Kang and McCabe 2020). Yet these arguments tend to focus mostly on the conduct and market position of online platforms, while ignoring the underlying technologies by which they operate. But what if techniques like machine learning (ML) are themselves factors in the continuous expansion of already oversized tech giants?


AI could provide 'early warning system' for catastrophic climate tipping points

#artificialintelligence

A new artificial intelligence system could assess tipping points in the world's ecosystems, and act as an early warning system to help stop "runaway climate change", researchers have said. Climate tipping points are a particular threat to life on Earth, as when they are reached, they can set off chain reactions of climate-altering processes, supercharging global heating and rapidly exacerbating the existing climate crisis. Examples include the melting of the Arctic permafrost, which could release massive amounts of the potent greenhouse gas methane, which would generate further rapid heating; the breakdown of ocean current systems, which would cause almost immediate major changes to global weather patterns; and ice sheet disintegration, which could lead to rapid sea-level rises. Using a "deep-learning" algorithm, the researchers examined thresholds beyond which rapid or irreversible change happens in a system. Chris Bauch, professor of applied mathematics at the University of Waterloo ...