Goto

Collaborating Authors

 Deep Learning


An Idea From Physics Helps AI See in Higher Dimensions

#artificialintelligence

The laws of physics stay the same no matter one's perspective. Now this idea is allowing computers to detect features in curved and higher-dimensional space.


Artificial Intelligence/Machine Learning Research at IARPA

#artificialintelligence

Cyber-attack Automated Unconventional Sensor Environment (CAUSE), applies AI/ML-based models to develop novel, automated methods for event-based detection and prediction of cyber-attacks significantly earlier than existing approaches. Forecasting cyber-attack events with actionable details advances the state-of-the-art by enabling threat-specific cyber incident response and defense measures; Creation of Operationally Realistic 3D Environment (CORE3D), uses machine learning and deep learning techniques to develop methods for the construction of a fully automated high fidelity 3D model of the world using remote sensing data; Deep Intermodal Video Analytics (DIVA), leverages machine learning techniques to develop robust automatic activity detection in streaming video across multiple cameras; Finding Engineering-Linked Indicators (FELIX), uses AI for detection of engineering signatures across multiple biological organisms. The goal is to distinguish natural organisms from those that have been engineered; Functional Map of the World Challenge, developed algorithms that would quickly and accurately classify 63 classes of buildings and regions in satellite imagery. All the top participants used various forms of deep learning; Functional Genomic and Computational Assessment of Threats (Fun GCAT), develops AI/ML-based approaches to learn and classify genetic (e.g., DNA) sequence data by genetic taxonomy, sequence function, and threat potential; Mercury Challenge, asked challenge participants to make use of AI/ML approaches to forecast a variety of political events in the Middle East and North Africa region, such as non-violent civil unrest and military activity; Machine Intelligence from Cortical Networks (MICrONS), aims to revolutionize machine learning by reverse-engineering the algorithms of the brain. The program is expressly designed as a dialogue between data science and neuroscience; Machine Translation for English Retrieval of Information in Any Language (MATERIAL), develops machine learning methods to identify foreign language information from speech and text relevant to English queries, and providing evidence of relevance of the retrieved information in English in a meaningful way.


Introduction to Different Activation Functions for Deep Learning

#artificialintelligence

The Idea of Neural Networks was first introduced way back in 1950s, but it wasn't until 2012 that they come to action. Even application of Optimization Algorithm(Gradient Descent) in 2006 by Hinton, wasn't giving good results, it was introduction and usage of Activation functions, which revolutionized Deep Learning Research. There are various kind of Activation Functions that exists, and Some Researchers are still working on finding better functions, which can help networks to converge faster or use less layers etc. Lets go through each of them: The Main Problem we face is because of Saturated Gradients, as the Function ranges between 0 to 1, the values might remain constant, thus the gradients will have very less values. It has all properties of ReLU, plus it will never have dead ReLU problem. We can consider different multiplication factor to form different variations of Leaky ReLU.



AI and Quantum Flow boosts Deep Learning speed 10x - 15x Faster - powered by pqlabs.ai

#artificialintelligence

"Quanta" is the plural of quantum. QuantaFlow AI SoC architecture is designed to simulate massive parallel transformation / evolution that is very similar to Quantum Computation. Quantum Computing is based on continuous unitary transformation of qu-bits. A qu-bit (quantum bit) can represent different possible states (e.g. a cat being mathematically both live and dead at the same time). Like the classical computing model, quantum computing also has 3 major procedures: Input, Process and Output.


Symplectic networks: Intrinsic structure-preserving networks for identifying Hamiltonian systems

arXiv.org Machine Learning

This work presents a framework of constructing the neural networks preserving the symplectic structure, so-called symplectic networks (SympNets). With the symplectic networks, we show some numerical results about (\romannumeral1) solving the Hamiltonian systems by learning abundant data points over the phase space, and (\romannumeral2) predicting the phase flows by learning a series of points depending on time. All the experiments point out that the symplectic networks perform much more better than the fully-connected networks that without any prior information, especially in the task of predicting which is unable to do within the conventional numerical methods.


Authorship Attribution in Bangla literature using Character-level CNN

arXiv.org Artificial Intelligence

Characters are the smallest unit of text that can extract stylometric signals to determine the author of a text. In this paper, we investigate the effectiveness of character-level signals in Authorship Attribution of Bangla Literature and show that the results are promising but improvable. The time and memory efficiency of the proposed model is much higher than the word level counterparts but accuracy is 2-5% less than the best performing word-level models. Comparison of various word-based models is performed and shown that the proposed model performs increasingly better with larger datasets. We also analyze the effect of pre-training character embedding of diverse Bangla character set in authorship attribution. It is seen that the performance is improved by up to 10% on pre-training. We used 2 datasets from 6 to 14 authors, balancing them before training and compare the results.


Reward Engineering for Object Pick and Place Training

arXiv.org Artificial Intelligence

Robotic grasping is a crucial area of research as it can result in the acceleration of the automation of several Industries utilizing robots ranging from manufacturing to healthcare. Reinforcement learning is the field of study where an agent learns a policy to execute an action by exploring and exploiting rewards from an environment. Reinforcement learning can thus be used by the agent to learn how to execute a certain task, in our case grasping an object. We have used the Pick and Place environment provided by OpenAI's Gym to engineer rewards. Hindsight Experience Replay (HER) has shown promising results with problems having a sparse reward. In the default configuration of the OpenAI baseline and environment the reward function is calculated using the distance between the target location and the robot end-effector. By weighting the cost based on the distance of the end-effector from the goal in the x,y and z-axes we were able to almost halve the learning time compared to the baselines provided by OpenAI, an intuitive strategy that further reduced learning time. In this project, we were also able to introduce certain user desired trajectories in the learnt policies (city-block / Manhattan trajectories). This helps us understand that by engineering the rewards we can tune the agent to learn policies in a certain way even if it might not be the most optimal but is the desired manner.


awslabs/autogluon

#artificialintelligence

AutoGluon automates machine learning tasks enabling you to easily achieve strong predictive performance in your applications. With just a few lines of code, you can train and deploy high-accuracy deep learning models on image, text, and tabular data. This library is licensed under the Apache 2.0 License.


awslabs/autogluon

#artificialintelligence

AutoGluon automates machine learning tasks enabling you to easily achieve strong predictive performance in your applications. With just a few lines of code, you can train and deploy high-accuracy deep learning models on image, text, and tabular data. This library is licensed under the Apache 2.0 License.