Deep Learning
A Framework for Explainable Text Classification in Legal Document Review
Mahoney, Christian J., Zhang, Jianping, Huber-Fliflet, Nathaniel, Gronvall, Peter, Zhao, Haozhen
Companies regularly spend millions of dollars producing electronically-stored documents in legal matters. Recently, parties on both sides of the 'legal aisle' are accepting the use of machine learning techniques like text classification to cull massive volumes of data and to identify responsive documents for use in these matters. While text classification is regularly used to reduce the discovery costs in legal matters, it also faces a peculiar perception challenge: amongst lawyers, this technology is sometimes looked upon as a "black box", little information provided for attorneys to understand why documents are classified as responsive. In recent years, a group of AI and ML researchers have been actively researching Explainable AI, in which actions or decisions are human understandable. In legal document review scenarios, a document can be identified as responsive, if one or more of its text snippets are deemed responsive. In these scenarios, if text classification can be used to locate these snippets, then attorneys could easily evaluate the model's classification decision. When deployed with defined and explainable results, text classification can drastically enhance overall quality and speed of the review process by reducing the review time. Moreover, explainable predictive coding provides lawyers with greater confidence in the results of that supervised learning task. This paper describes a framework for explainable text classification as a valuable tool in legal services: for enhancing the quality and efficiency of legal document review and for assisting in locating responsive snippets within responsive documents. This framework has been implemented in our legal analytics product, which has been used in hundreds of legal matters. We also report our experimental results using the data from an actual legal matter that used this type of document review.
On-policy Reinforcement Learning with Entropy Regularization
Liu, Jingbin, Gu, Xinyang, Zhang, Dexiang, Liu, Shuai
Entropy regularization is an imported idea in reinforcement learning, with great success in recent algorithms like Soft Actor Critic and Soft Q Network. In this work we extend this idea into the on-policy realm. With the soft gradient policy theorem, we construct the maximum entropy reinforcement learning framework for on-policy RL. For policy gradient based on-policy algorithms, policy network is often represented as Gaussian distribution with the action variance restricted to be global for all the states observed from the environment. We propose an idea called action variance scale for policy network and find it can work collaboratively with the idea of entropy regularization. In this paper, we choose the state-of-the-art on-policy algorithm, Proximal Policy Optimization, as our basal algorithm and present Soft Proximal Policy Optimization (SPPO). PPO is a popular on-policy RL algorithm with great stability and parallelism. But like many on-policy algorithm, PPO can also suffer from low sample efficiency and local optimum problem. In the entropy-regularized framework, SPPO can guide the agent to succeed at the task while maintaining exploration by acting as randomly as possible. Our method outperforms prior works on a range of continuous control benchmark tasks, Furthermore, our method can be easily extended to large scale experiment and achieve stable learning at high throughput.
Deep Reinforcement Learning for Motion Planning of Mobile Robots
Butyrev, Leonid, Edelhรคuรer, Thorsten, Mutschler, Christopher
This paper presents a novel motion and trajectory planning algorithm for nonholonomic mobile robots that uses recent advances in deep reinforcement learning. Starting from a random initial state, i.e., position, velocity and orientation, the robot reaches an arbitrary target state while taking both kinematic and dynamic constraints into account. Our deep reinforcement learning agent not only processes a continuous state space it also executes continuous actions, i.e., the acceleration of wheels and the adaptation of the steering angle. We evaluate our motion and trajectory planning on a mobile robot with a differential drive in a simulation environment.
Measuring the Quality of Explanations: The System Causability Scale (SCS). Comparing Human and Machine Explanations
Holzinger, Andreas, Carrington, Andrรฉ, Mรผller, Heimo
Recent success in Artificial Intelligence (AI) and Machine Learning (ML) allow problem solving automatically without any human intervention. Autonomous approaches can be very convenient. However, in certain domains, e.g., in the medical domain, it is necessary to enable a domain expert to understand, why an algorithm came up with a certain result. Consequently, the field of Explainable AI (xAI) rapidly gained interest worldwide in various domains, particularly in medicine. Explainable AI studies transparency and traceability of opaque AI/ML and there are already a huge variety of methods. For example with layer-wise relevance propagation relevant parts of inputs to, and representations in, a neural network which caused a result, can be highlighted. This is a first important step to ensure that end users, e.g., medical professionals, assume responsibility for decision making with AI/ML and of interest to professionals and regulators. Interactive ML adds the component of human expertise to AI/ML processes by enabling them to re-enact and retrace AI/ML results, e.g. let them check it for plausibility. This requires new human-AI interfaces for explainable AI. In order to build effective and efficient interactive human-AI interfaces we have to deal with the question of how to evaluate the quality of explanations given by an explainable AI system. In this paper we introduce our System Causability Scale (SCS) to measure the quality of explanations. It is based on our notion of Causability (Holzinger et al., 2019) combined with concepts adapted from a widely accepted usability scale.
How to Run NGC Deep Learning Containers with Singularity NVIDIA Developer Blog
New scientific breakthroughs are being made possible by the convergence of HPC and AI. It is now necessary to deploy both HPC and AI workloads on the same system. The complexity of the software environments needed to support HPC and AI workloads is huge. Application software depends on many interdependent software packages. Just getting a successful build can be a challenge, let alone ensuring the build is optimized to take advantage of the very latest hardware and software capabilities.
Global Deep Learning System Market Analysis by Market Key Player, Product Application & Geography
Deep Learning System Market report offers detailed analysis and a five-year forecast for the global Deep Learning System industry. Deep Learning System market report delivers the insights which will shape your strategic planning as you estimate geographic, product or service expansion within the Deep Learning System industry.. The Deep Learning System market accounted for $XX million in 2018, and is expected to reach $XX million by 2024, registering a CAGR of YY% from 2019 to 2024. The global Deep Learning System market is segmented based on product, end user, and region. Region wise, it is analyzed across North America (U.S., Canada, and Mexico), Europe (Germany, UK, Italy, Spain, France, and rest of Europe), Asia-Pacific (Japan, China, Australia, India, South Korea, Taiwan, and, rest of Asia-Pacific) and EMEA (Brazil, South Africa, Saudi Arabia, UAE, rest of EMEA). Ask more details or request custom reports to our experts at https://www.proaxivereports.com/pre-order/12206 Moreover, other factors that contribute toward the growth of the Deep Learning System market include favorable government initiatives related to the use of Deep Learning System.
Deep-learning tool detects whoppers with 90 per cent accuracy
The tool uses deep-learning algorithms: a type of machine learning algorithm which processes data through successive layers to extract increasingly meaningful and complex information. This algorithm โ which the researchers were motivated to create by the proliferation of politically motivated viral deception online โ determines whether claims made in news stories or social media posts are supported by other content on the same subject. "If they are: great, it's probably a real story," said Professor Alexander Wong, a systems design engineering expert at the University of Waterloo. The algorithm was trained with tens of thousands of claims paired with stories that either supported or rejected them. The researchers tested their system using a dataset created for the 2017 Fake News Challenge.
Our Investment in Hugging Face
A seminal moment in machine learning took place on Sept 30, 2012 when a convolutional neural network called AlexNet achieved groundbreaking results in the ImageNet competition. This kicked off a race of rapidly improving computer vision models to the point where the technology outperformed humans in many tasks. These breakthroughs accelerated industries such as autonomous vehicles, consumer mobile applications, and created new multi billion dollar opportunities around computing architectures for machine learning training and inference. Natural Language Processing (NLP), another discipline of machine learning has seemed to lag behind in progress relative to computer vision. Recently NLP may have had its "ImageNet" moment due to new transformers models (e.g., GPT2 and BERT) shattering performance benchmarks.
Investorideas.com Newswire - The AI Eye: NVIDIA (Nasdaq: NVDA) Introduces TensorRT 7, Provides Access to Deep Neural Networks for Autonomous Vehicles, Baidu (Nasdaq: BIDU) and Samsung Ready for AI-Chip Production in 2020
NVIDIA Corporation (NasdaqGS:NVDA) today introduced the TensorRT 7, which is "the seventh generation of the company's inference software development kit" to deliver conversational AI applications. "We have entered a new chapter in AI, where machines are capable of understanding human language in real time. TensorRT 7 helps make this possible, providing developers everywhere with the tools to build and deploy faster, smarter conversational AI services that allow more natural human-to-AI interaction." The company also announced that it will provide the transportation industry with access to its NVIDIA DRIVE deep neural networks (DNNs) for autonomous vehicle development on the NVIDIA GPU Cloud (NGC) container registry. "The AI autonomous vehicle is a software-defined vehicle required to operate around the world on a wide variety of datasets. By providing AV developers access to our DNNs and the advanced learning tools to optimize them for multiple datasets, we're enabling shared learning across companies and countries, while maintaining data ownership and privacy. Ultimately, we are accelerating the reality of global autonomous vehicles."
Multi-Institutional Validation of Deep Learning for Pretreatment Identification of Extranodal Extension in Head and Neck Squamous Cell Carcinoma
Extranodal extension (ENE) is a well-established poor prognosticator and an indication for adjuvant treatment escalation in patients with head and neck squamous cell carcinoma (HNSCC). Identification of ENE on pretreatment imaging represents a diagnostic challenge that limits its clinical utility. We previously developed a deep learning algorithm that identifies ENE on pretreatment computed tomography (CT) imaging in patients with HNSCC. We sought to validate our algorithm performance for patients from a diverse set of institutions and compare its diagnostic ability to that of expert diagnosticians.