FDA
Semantic Similarity-Informed Bayesian Borrowing for Quantitative Signal Detection of Adverse Events
Haguinet, François, Painter, Jeffery L, Powell, Gregory E, Callegaro, Andrea, Bate, Andrew
We present a Bayesian dynamic borrowing (BDB) approach to enhance the quantitative identification of adverse events (AEs) in spontaneous reporting systems (SRSs). The method embeds a robust meta-analytic predictive (MAP) prior with a Bayesian hierarchical model and incorporates semantic similarity measures (SSMs) to enable weighted information sharing from clinically similar MedDRA Preferred Terms (PTs) to the target PT. This continuous similarity-based borrowing overcomes limitations of rigid hierarchical grouping in current disproportionality analysis (DPA). Using data from the FDA Adverse Event Reporting System (FAERS) between 2015 and 2019, we evaluate our approach -- termed IC SSM -- against traditional Information Component (IC) analysis and IC with borrowing at the MedDRA high-level group term level (IC HLGT). A reference set (PVLens), derived from FDA product label update, enabled prospective evaluation of method performance in identifying AEs prior to official labeling. The IC SSM approach demonstrated higher sensitivity (1332/2337=0.570, Youden's J=0.246) than traditional IC (Se=0.501, J=0.250) and IC HLGT (Se=0.556, J=0.225), consistently identifying more true positives and doing so on average 5 months sooner than traditional IC. Despite a marginally lower aggregate F1-score and Youden's index, IC SSM showed higher performance in early post-marketing periods or when the detection threshold was raised, providing more stable and relevant alerts than IC HLGT and traditional IC. These findings support the use of SSM-informed Bayesian borrowing as a scalable and context-aware enhancement to traditional DPA methods, with potential for validation across other datasets and exploration of additional similarity metrics and Bayesian strategies using case-level data.
Automated Real-time Assessment of Intracranial Hemorrhage Detection AI Using an Ensembled Monitoring Model (EMM)
Fang, Zhongnan, Johnston, Andrew, Cheuy, Lina, Na, Hye Sun, Paschali, Magdalini, Gonzalez, Camila, Armstrong, Bonnie A., Koirala, Arogya, Laurel, Derrick, Campion, Andrew Walker, Iv, Michael, Chaudhari, Akshay S., Larson, David B.
A rtificial intelligence (AI) tools for radiology are commonly unmonitored once deployed . Th e lack of real - time case - by - c ase assessments of AI prediction confidence require s users to independently distinguish between trustworthy and unreliable AI predictions, which increas es cognitive burden, r educ es productivity, and potentially lead s to misdiagnos e s. To address these challenges, we introduce Ensembled Monitoring Model (EMM), a framework inspired by clinical consensus practices using multiple expert reviews. Designed specifically for black - box commercial AI products, EMM operates independently without requiring access to interna l AI components or intermediate outputs, while still providing robust confidence measurements. Using intracranial hemorrhage detection as our test case on a large, diverse dataset of 2919 studies, we demonstrate that EMM successfully categorizes confidence in the AI - generated prediction, suggesting different actions and helping improve the overall performance of AI tools to ultimately reduc e cognitive burden . Importantly, we provide key technical considerations and best practices for successfully translating EMM into clinical settings .
The Download: Montana's experimental treatments, and Google DeepMind's new AI agent
The news: A bill that allows clinics to sell unproven treatments has been passed in Montana. Under the legislation, doctors can apply for a license to open an experimental treatment clinic and recommend and sell therapies not approved by the Food and Drug Administration (FDA) to their patients. Why it matters: Once it's signed by the governor, the law will be the most expansive in the country in allowing access to drugs that have not been fully tested. The bill allows for any drug produced in the state to be sold in it, providing it has been through phase I clinical trials--but these trials do not determine if the drug is effective. The big picture: The bill was drafted and lobbied for by people interested in extending human lifespans.
Rice-sized robot could make brain surgery safer and less invasive
Surgeries may become safer and more precise than ever before. A French startup named Robeauté has just raised about 29 million to develop a truly groundbreaking neurosurgical microrobot. Imagine a device no bigger than a grain of rice that can carefully navigate the complex and delicate pathways of the brain. This little robot could change the way doctors treat brain tumors and other neurological conditions, making surgeries safer and more precise than ever before. Join The FREE CyberGuy Report: Get my expert tech tips, critical security alerts, and exclusive deals -- plus instant access to my free Ultimate Scam Survival Guide when you sign up! Brain surgery is incredibly complex.
Comparative Study of Generative Models for Early Detection of Failures in Medical Devices
Sadanandan, Binesh, Nobar, Bahareh Arghavani, Behzadan, Vahid
The medical device industry has significantly advanced by integrating sophisticated electronics like microchips and field-programmable gate arrays (FPGAs) to enhance the safety and usability of life-saving devices. These complex electro-mechanical systems, however, introduce challenging failure modes that are not easily detectable with conventional methods. Effective fault detection and mitigation become vital as reliance on such electronics grows. This paper explores three generative machine learning-based approaches for fault detection in medical devices, leveraging sensor data from surgical staplers,a class 2 medical device. Historically considered low-risk, these devices have recently been linked to an increasing number of injuries and fatalities. The study evaluates the performance and data requirements of these machine-learning approaches, highlighting their potential to enhance device safety.
OpenAI and the FDA Are Holding Talks About Using AI In Drug Evaluation
The Food and Drug Administration has been meeting with OpenAI to discuss the agency's use of AI, according to sources with knowledge of the meetings. The meetings appear to be part of a broader effort at the FDA to use this technology to speed up the drug approval process. "Why does it take over 10 years for a new drug to come to market?" "Why are we not modernized with AI and other things? We've just completed our first AI-assisted scientific review for a product and that's just the beginning."
Data over dialogue: Why artificial intelligence is unlikely to humanise medicine
Recently, a growing number of experts in artificial intelligence (AI) and medicine have be-gun to suggest that the use of AI systems, particularly machine learning (ML) systems, is likely to humanise the practice of medicine by substantially improving the quality of clinician-patient relationships. In this thesis, however, I argue that medical ML systems are more likely to negatively impact these relationships than to improve them. In particular, I argue that the use of medical ML systems is likely to comprise the quality of trust, care, empathy, understanding, and communication between clinicians and patients.
FDA phasing out some animal testing in 'win-win' for ethics and public health: commissioner
Dr. Marty Makary pointed out the Biden administration's decision to skip key committee meetings when authorizing vaccines in response to a top Democrat's question. FIRST ON FOX -- The Food and Drug Administration is phasing out an animal testing requirement for antibody therapies and other drugs in favor of testing on materials that mimic human organs, the FDA announced on Thursday. "For too long, drug manufacturers have performed additional animal testing of drugs that have data in broad human use internationally. This initiative marks a paradigm shift in drug evaluation and holds promise to accelerate cures and meaningful treatments for Americans while reducing animal use," FDA Commissioner Martin A. Makary, said in comment provided to Fox News Digital. "By leveraging AI-based computational modeling, human organ model-based lab testing, and real-world human data, we can get safer treatments to patients faster and more reliably, while also reducing R&D costs and drug prices. It is a win-win for public health and ethics."
Crowdsourcing-Based Knowledge Graph Construction for Drug Side Effects Using Large Language Models with an Application on Semaglutide
Duan, Zhijie, Wei, Kai, Xue, Zhaoqian, Zhou, Jiayan, Yang, Shu, Ma, Siyuan, Jin, Jin, li, Lingyao
Social media is a rich source of real-world data that captures valuable patient experience information for pharmacovigilance. However, mining data from unstructured and noisy social media content remains a challenging task. We present a systematic framework that leverages large language models (LLMs) to extract medication side effects from social media and organize them into a knowledge graph (KG). We apply this framework to semaglutide for weight loss using data from Reddit. Using the constructed knowledge graph, we perform comprehensive analyses to investigate reported side effects across different semaglutide brands over time. These findings are further validated through comparison with adverse events reported in the FAERS database, providing important patient-centered insights into semaglutide's side effects that complement its safety profile and current knowledge base of semaglutide for both healthcare professionals and patients. Our work demonstrates the feasibility of using LLMs to transform social media data into structured KGs for pharmacovigilance.
Are clinicians ethically obligated to disclose their use of medical machine learning systems to patients?
It is commonly accepted that clinicians are ethically obligated to disclose their use of medical machine learning systems to patients, and that failure to do so would amount to a moral fault for which clinicians ought to be held accountable. Call this "the disclosure thesis." Four main arguments have been, or could be, given to support the disclosure thesis in the ethics literature: the risk-based argument, the rights-based argument, the materiality argument, and the autonomy argument. In this article, I argue that each of these four arguments are unconvincing, and therefore, that the disclosure thesis ought to be rejected. I suggest that mandating disclosure may also even risk harming patients by providing stakeholders with a way to avoid accountability for harm that results from improper applications or uses of these systems.