FDA
Shape Analysis for Pediatric Upper Body Motor Function Assessment
Kumar, Shashwat, Gutierez, Robert, Datta, Debajyoti, Tolman, Sarah, McCrady, Allison, Blemker, Silvia, Scharf, Rebecca J., Barnes, Laura
Neuromuscular disorders, such as Spinal Muscular Atrophy (SMA) and Duchenne Muscular Dystrophy (DMD), cause progressive muscular degeneration and loss of motor function for 1 in 6,000 children. Traditional upper limb motor function assessments do not quantitatively measure patient-performed motions, which makes it difficult to track progress for incremental changes. Assessing motor function in children with neuromuscular disorders is particularly challenging because they can be nervous or excited during experiments, or simply be too young to follow precise instructions. These challenges translate to confounding factors such as performing different parts of the arm curl slower or faster (phase variability) which affects the assessed motion quality. This paper uses curve registration and shape analysis to temporally align trajectories while simultaneously extracting a mean reference shape. Distances from this mean shape are used to assess the quality of motion. The proposed metric is invariant to confounding factors, such as phase variability, while suggesting several clinically relevant insights. First, there are statistically significant differences between functional scores for the control and patient populations (p$=$0.0213$\le$0.05). Next, several patients in the patient cohort are able to perform motion on par with the healthy cohort and vice versa. Our metric, which is computed based on wearables, is related to the Brooke's score ((p$=$0.00063$\le$0.05)), as well as motor function assessments based on dynamometry ((p$=$0.0006$\le$0.05)). These results show promise towards ubiquitous motion quality assessment in daily life.
AI In Healthcare Highlights & Milestones Summer 2022
This is my new AI in Healthcare Highlights & Milestones Report for Summer 2022. This report includes an overview of advances made during the summer across the healthcare spectrum including important studies, regulatory clearances, fundraising, partnerships, and growth in the AI ecosystem worldwide. This summer scientists demonstrated how they successfully used AI in many areas including: to reduce sepsis deaths, to predict cardiac events, to detect breast cancer, to detect lung cancer, to detects osteoporosis, to detect Parkinson's, to monitor diabetic retinopathy, to detect heart disease, to detect bladder cancer, to enable pathology, to detect fractures, and to monitor Parkinson's using the Apple Watch. In July scientists in Germany published a large scale study demonstrating that radiologists working with AI were more accurate detecting breast cancer than radiologists working without AI, and vice versa - the AI was more accurate when working with a radiologist than when working independently. The study was led by Vara, a German company, in collaboration with radiologists at the Essen University Hospital in Germany and the Memorial Sloan Kettering Cancer Center in New York. Vara's AI is has been used by radiologists in German breast screening centers for two years and is used in 30% of Germany's breast cancer screening centers. Vara's AI software is also used to screen for breast cancer in a hospital in Mexico and in a hospital in Greece.
Dyad Medical Secures FDA Clearance For Echo:Prio Cardiac Imaging Analysis Platform
Dyad Medical, Inc., the developer of the cloud-based AI technology for cardiac image analysis, announced that the U.S. Food and Drug Administration (FDA) has cleared its Echocardiogram application called Echo:Prio through the 510(k) pathway. Echo:Prio, part of the complete cardiac platform named Libby, offers fast, data-driven image analysis of echocardiogram images. It is an important decision-making support tool for index quantification of cardiac function saving the clinician time in diagnosis and treatment-decision making. Echocardiograms are often the first step in diagnosing and developing a treatment plan for heart disease. The heart is the only organ in constant movement as it pumps blood throughout the body.
Semi-automated Extraction of Literature Data Using Machine Learning Methods
NICEATM, other scientists within the NIEHS Division of the NTP, the DOE's Oak Ridge National Laboratory, and FDA are collaborating to automate the process of identifying high-quality developmental toxicity studies in the published scientific literature. The approach applies natural language processing and machine learning methods to identify specific data elements in the full text of scientific publications using both unsupervised and supervised approaches. Preliminary models were trained using a uterotrophic database (Kleinstreuer et al. 2016) built for the EPA Endocrine Disruptor Screening Program. The models leveraged natural language processing and multivariate machine learning models to identify papers that meet minimum criteria to be considered guideline-like studies (Herrmannova et al. 2018). Supervised and unsupervised approaches were developed to automatically extract text features that correspond to study descriptors and classify papers based on their adherence to minimum criteria derived from regulatory guideline studies.
Review of the AMLAS Methodology for Application in Healthcare
Laher, Shakir, Brackstone, Carla, Reis, Sara, Nguyen, An, White, Sean, Habli, Ibrahim
In recent years, the number of machine learning (ML) technologies gaining regulatory approval for healthcare has increased significantly allowing them to be placed on the market. However, the regulatory frameworks applied to them were originally devised for traditional software, which has largely rule-based behaviour, compared to the data-driven and learnt behaviour of ML. As the frameworks are in the process of reformation, there is a need to proactively assure the safety of ML to prevent patient safety being compromised. The Assurance of Machine Learning for use in Autonomous Systems (AMLAS) methodology was developed by the Assuring Autonomy International Programme based on well-established concepts in system safety. This review has appraised the methodology by consulting ML manufacturers to understand if it converges or diverges from their current safety assurance practices, whether there are gaps and limitations in its structure and if it is fit for purpose when applied to the healthcare domain. Through this work we offer the view that there is clear utility for AMLAS as a safety assurance methodology when applied to healthcare machine learning technologies, although development of healthcare specific supplementary guidance would benefit those implementing the methodology.
Review finds 'paucity of robust evidence' on impact of AI clinical outcomes
AI-assisted tools have begun to make a mark on healthcare, with a 2020 study finding 64 FDA-approved devices and algorithms based on artificial intelligence and machine learning. Yet, the systematic review found a lack of evidence to support the technologies. "Despite the plethora of claims for the benefits of AI in enhancing clinical outcomes, there is a paucity of robust evidence. In this systematic review, we identified only a handful of RCTs comparing AI-assisted tools with standard-of-care management in various medical conditions," the authors wrote. Many of the 39 studies had limitations that affect the generalizability of their results.
Tailoring Molecules for Protein Pockets: a Transformer-based Generative Solution for Structured-based Drug Design
Wu, Kehan, Xia, Yingce, Fan, Yang, Deng, Pan, Liu, Haiguang, Wu, Lijun, Xie, Shufang, Wang, Tong, Qin, Tao, Liu, Tie-Yan
Structure-based drug design is drawing growing attentions in computer-aided drug discovery. Compared with the virtual screening approach where a pre-defined library of compounds are computationally screened, de novo drug design based on the structure of a target protein can provide novel drug candidates. In this paper, we present a generative solution named TamGent (Target-aware molecule generator with Transformer) that can directly generate candidate drugs from scratch for a given target, overcoming the limits imposed by existing compound libraries. Following the Transformer framework (a state-of-the-art framework in deep learning), we design a variant of Transformer encoder to process 3D geometric information of targets and pre-train the Transformer decoder on 10 million compounds from PubChem for candidate drug generation. Systematical evaluation on candidate compounds generated for targets from DrugBank shows that both binding affinity and drugability are largely improved. TamGent outperforms previous baselines in terms of both effectiveness and efficiency. The method is further verified by generating candidate compounds for the SARS-CoV-2 main protease and the oncogenic mutant KRAS G12C. The results show that our method not only re-discovers previously verified drug molecules , but also generates novel molecules with better docking scores, expanding the compound pool and potentially leading to the discovery of novel drugs.
Compound virtual screening by learning-to-rank with gradient boosting decision tree and enrichment-based cumulative gain
Learning-to-rank, a machine learning technique widely used in information retrieval, has recently been applied to the problem of ligand-based virtual screening, to accelerate the early stages of new drug development. Ranking prediction models learn based on ordinal relationships, making them suitable for integrating assay data from various environments. Existing studies of rank prediction in compound screening have generally used a learning-to-rank method called RankSVM. However, they have not been compared with or validated against the gradient boosting decision tree (GBDT)-based learning-to-rank methods that have gained popularity recently. Furthermore, although the ranking metric called Normalized Discounted Cumulative Gain (NDCG) is widely used in information retrieval, it only determines whether the predictions are better than those of other models. In other words, NDCG is incapable of recognizing when a prediction model produces worse than random results. Nevertheless, NDCG is still used in the performance evaluation of compound screening using learning-to-rank. This study used the GBDT model with ranking loss functions, called lambdarank and lambdaloss, for ligand-based virtual screening; results were compared with existing RankSVM methods and GBDT models using regression. We also proposed a new ranking metric, Normalized Enrichment Discounted Cumulative Gain (NEDCG), which aims to properly evaluate the goodness of ranking predictions. Results showed that the GBDT model with learning-to-rank outperformed existing regression methods using GBDT and RankSVM on diverse datasets. Moreover, NEDCG showed that predictions by regression were comparable to random predictions in multi-assay, multi-family datasets, demonstrating its usefulness for a more direct assessment of compound screening performance.
Demystifying the COVID-19 vaccine discourse on Twitter
Zaidi, Zainab, Ye, Mengbin, Samon, Fergus John, Jama, Abdisalam, Gopalakrishnan, Binduja, Gu, Chenhao, Karunasekera, Shanika, Evans, Jamie, Kashima, Yoshihisa
Developing an understanding of the public discourse on COVID-19 vaccination on social media is important not only for addressing the current COVID-19 pandemic, but also for future pathogen outbreaks. We examine a Twitter dataset containing 75 million English tweets discussing COVID-19 vaccination from March 2020 to March 2021. We train a stance detection algorithm using natural language processing (NLP) techniques to classify tweets as `anti-vax' or `pro-vax', and examine the main topics of discourse using topic modelling techniques. While pro-vax tweets (37 million) far outnumbered anti-vax tweets (10 million), a majority of tweets from both stances (63% anti-vax and 53% pro-vax tweets) came from dual-stance users who posted both pro- and anti-vax tweets during the observation period. Pro-vax tweets focused mostly on vaccine development, while anti-vax tweets covered a wide range of topics, some of which included genuine concerns, though there was a large dose of falsehoods. A number of topics were common to both stances, though pro- and anti-vax tweets discussed them from opposite viewpoints. Memes and jokes were amongst the most retweeted messages. Whereas concerns about polarisation and online prevalence of anti-vax discourse are unfounded, targeted countering of falsehoods is important.
VIDEO: Overview of radiology AI by Keith Dreyer
Keith J. Dreyer, DO, PhD, FACR, American College of Radiology (ACR) Data Science Institute Chief Science Officer, explains the state of artificial intelligence (AI) in radiology in 2022. Although there are about 200 AI algorithms for medical imaging now cleared by the U.S. Food and Drug Administration (FDA), a recent ACR survey of its members showed AI only has about a 2% market penetration rate. "So, there is about another 98% that fall into the category of potential addressable market," Dreyer said. "Now why is that when there is a lot of enthusiasm and we are past the days from six years ago when radiologists were fearful of losing their jobs to AI because Geoffrey Hinton said we should stop training radiologists because AI will take over in another 5 years. That was in 2016, and are now past the five-year mark and it's ridiculous, because today there is an incredible shortage of radiologists."