Goto

Collaborating Authors

 South America


Exascale Deep Learning for Scientific Inverse Problems

arXiv.org Machine Learning

We introduce novel communication strategies in synchronous distributed Deep Learning consisting of decentralized gradient reduction orchestration and computational graph-aware grouping of gradient tensors. Networks (DNN) models and data sets (Dai et al., 2019), the need for efficient distributed machine learning strategies on massively parallel systems is more significant than On small to moderate-scale systems, with 10's - 100's of GPU/TPU accelerators, these scaling inefficiencies can be difficult to detect and systematically optimize due to system noise and load variability. The scaling inefficiencies of data-parallel implementations are most readily apparent on large-scale systems such as supercomputers with 1,000's-10,000's of accelerators. Extending data-parallelism to the massive scale of super-computing systems is also motivated by the latter's traditional workload consisting of scientific numerical simulations (Kent & Kotliar, 2018). NVLink interconnect, supporting a (peak) bidirectional bandwidth of 100 GB/s, where each 3 V100 GPUs are grouped in a ring topology with all-to-all connections to a POWER9 CPU.


Attraction-Repulsion Actor-Critic for Continuous Control Reinforcement Learning

arXiv.org Artificial Intelligence

Continuous control tasks in reinforcement learning are important because they provide an important framework for learning in high-dimensional state spaces with deceptive rewards, where the agent can easily become trapped into suboptimal solutions. One way to avoid local optima is to use a population of agents to ensure coverage of the policy space, yet learning a population with the "best" coverage is still an open problem. In this work, we present a novel approach to population-based RL in continuous control that leverages properties of normalizing flows to perform attractive and repulsive operations between current members of the population and previously observed policies. Empirical results on the MuJoCo suite demonstrate a high performance gain for our algorithm compared to prior work, including Soft-Actor Critic (SAC).


Better Language Models and Their Implications

#artificialintelligence

We've trained a large-scale unsupervised language model which generates coherent paragraphs of text, achieves state-of-the-art performance on many language modeling benchmarks, and performs rudimentary reading comprehension, machine translation, question answering, and summarization--all without task-specific training. Our model, called GPT-2 (a successor to GPT), was trained simply to predict the next word in 40GB of Internet text. Due to our concerns about malicious applications of the technology, we are not releasing the trained model. As an experiment in responsible disclosure, we are instead releasing a much smaller model for researchers to experiment with, as well as a technical paper. GPT-2 is a large transformer-based language model with 1.5 billion parameters, trained on a dataset[1] of 8 million web pages. GPT-2 is trained with a simple objective: predict the next word, given all of the previous words within some text. The diversity of the dataset causes this simple goal to contain naturally occurring demonstrations of many tasks across diverse domains. GPT-2 is a direct scale-up of GPT, with more than 10X the parameters and trained on more than 10X the amount of data. GPT-2 displays a broad set of capabilities, including the ability to generate conditional synthetic text samples of unprecedented quality, where we prime the model with an input and have it generate a lengthy continuation. In addition, GPT-2 outperforms other language models trained on specific domains (like Wikipedia, news, or books) without needing to use these domain-specific training datasets. On language tasks like question answering, reading comprehension, summarization, and translation, GPT-2 begins to learn these tasks from the raw text, using no task-specific training data.


Healthcare Artificial Intelligence Market Opportunity Analysis, Vendor Landscape, Growth, Developments & Forecast 2019-2025, DEEP GENOMICS, Next IT Corp., General Vision, Google, NVIDIA Corporation, IBM Watson Health – Market Expert24

#artificialintelligence

As the application of artificial intelligence (AI) in the field of drug development increases, market growth is greatly favored. Artificial intelligence (AI) is called engineering and science adopted to design intelligent machines, such as intelligent computer programs. A system that applies multiple human intelligence-based functions, such as learning, reasoning, and problem-solving skills in areas such as computer science, biology, linguistics, mathematics, and engineering. Artificial intelligence is regarded as the next boundary of medical innovation. Healthcare's AI is implemented to align structured and unstructured data.


Global Artificial Intelligence (AI) in Fintech Market 2019 Emerging Growth Opportunities – Autodesk, IBM, Microsoft, Oracle, SAP, Fanuc, Hanson Robotics, – OnYourDesks

#artificialintelligence

Global Artificial Intelligence (AI) in Fintech Market 2019 by Company, Regions, Type and Application, Forecast to 2024 presents the conceptual study and strategic analysis on global Artificial Intelligence (AI) in Fintech market which provides market scope, applications, and geographical presence which drive the market. The report gives an intensive investigation of the notable driving elements that are recognized considering the end-client requests, variable market changes, and limiting components. The report analyzes, tracks, and presents the worldwide market size of the key players in each region around the world. The present competitive landscape, prevalent business models, and advancements in the coming years are evaluated in this report. An in-depth approach about the global Artificial Intelligence (AI) in Fintech market players will help all market players in analyzing the recent market trends and essential commercial enterprise strategies. The study provides an acknowledged and extensive analysis of the immediate state of the market.


KT and WeDo Technologies Collaborate on Using Artificial Intelligence to Detect Fraud

#artificialintelligence

AI-IRSF is an AI system that prevents a fraud that involves hacking of IP-PBX (IP telephony exchange) to generate illegal calls to international numbers. With this Cooperation Agreement, KT will develop and supply more AI based FMS modules to integrate with WeDo's Fraud and Risk Management system. Additional AI based modules will also run on the WeDo's system, and the modular capability of RAID will allow CSPs to choose from different fraud detection models for their market similar to how one chooses applications from a smartphone app store. The open architecture of RAID will also allow other CSPs to develop their own models as well. WeDo Technologies is part of the Mobileum group, a leading enterprise software and analytics company in roaming, security, fraud and risk management serving more than 700 telecommunication providers in more than 180 countries.


Will AI lead to job cuts or will the tech improve working lives?

#artificialintelligence

In the initial phase I would not be worried about healthcare job cuts. AI implementation will constitute a great opportunity for healthcare specialists to improve the way we perform our duties and collaborate in the development of a new technology. As a cardiac imaging specialist, one of the great advances could be the automatisation of routine and time-consuming tasks that, with the help of AI, could become more efficient and consistently accurate. At the end of the day, this will save a lot of time that could be used on other activities by the healthcare workers. In the first phase, the healthcare worker will confirm the work of the machine, but from my point of view, probably, in a second phase, the results will be accepted without human intervention.


Non-monotonic Logical Reasoning Guiding Deep Learning for Explainable Visual Question Answering

arXiv.org Artificial Intelligence

State of the art algorithms for many pattern recognition problems rely on deep network models. Training these models requires a large labeled dataset and considerable computational resources. Also, it is difficult to understand the working of these learned models, limiting their use in some critical applications. Towards addressing these limitations, our architecture draws inspiration from research in cognitive systems, and integrates the principles of commonsense logical reasoning, inductive learning, and deep learning. In the context of answering explanatory questions about scenes and the underlying classification problems, the architecture uses deep networks for extracting features from images and for generating answers to queries. Between these deep networks, it embeds components for non-monotonic logical reasoning with incomplete commonsense domain knowledge, and for decision tree induction. It also incrementally learns and reasons with previously unknown constraints governing the domain's states. We evaluated the architecture in the context of datasets of simulated and real-world images, and a simulated robot computing, executing, and providing explanatory descriptions of plans. Experimental results indicate that in comparison with an ``end to end'' architecture of deep networks, our architecture provides better accuracy on classification problems when the training dataset is small, comparable accuracy with larger datasets, and more accurate answers to explanatory questions. Furthermore, incremental acquisition of previously unknown constraints improves the ability to answer explanatory questions, and extending non-monotonic logical reasoning to support planning and diagnostics improves the reliability and efficiency of computing and executing plans on a simulated robot.


Informing a BDI Player Model for an Interactive Narrative

arXiv.org Artificial Intelligence

This work focuses on studying players behaviour in interactive narratives with the aim to simulate their choices. Besides sub-optimal player behaviour due to limited knowledge about the environment, the difference in each player's style and preferences represents a challenge when trying to make an intelligent system mimic their actions. Based on observations from players interactions with an extract from the interactive fiction Anchorhead, we created a player profile to guide the behaviour of a generic player model based on the BDI (Belief-Desire-Intention) model of agency. We evaluated our approach using qualitative and quantitative methods and found that the player profile can improve the performance of the BDI player model. However, we found that players self-assessment did not yield accurate data to populate their player profile under our current approach.


Artificial Intelligence in Supply Chain Market Competitive Scenario, Financial Overview, and High-Profit Margins – Business Intelligence

#artificialintelligence

The demand for artificial intelligence has grown significantly in the last few years due to the advantages it provides. Rising use of big data, growing demand for greater transparency and visibility into supply chain data and processes, and increasing adoption of AI for improving consumer services and satisfaction are some of the other factors driving the demand in this market. Moreover, growing applicability of AI in various industries has further augmented the demand in this market. The global artificial intelligence in supply chain market could be classified on basis of technology, application, end-user industry, and offerings. The end-user industry category can further be segmented into manufacturing, aerospace, automotive, retail, consumer packaged goods, healthcare, food and beverages, and others.