infiltration
An Explainable Hybrid AI Framework for Enhanced Tuberculosis and Symptom Detection
Patel, Neel, Wong, Alexander, Ebadi, Ashkan
Tuberculosis remains a critical global health issue, particularly in resource-limited and remote areas. Early detection is vital for treatment, yet the lack of skilled radiologists underscores the need for artificial intelligence (AI)-driven screening tools. Developing reliable AI models is challenging due to the necessity for large, high-quality datasets, which are costly to obtain. To tackle this, we propose a teacher--student framework which enhances both disease and symptom detection on chest X-rays by integrating two supervised heads and a self-supervised head. Our model achieves an accuracy of 98.85% for distinguishing between COVID-19, tuberculosis, and normal cases, and a macro-F1 score of 90.09% for multilabel symptom detection, significantly outperforming baselines. The explainability assessments also show the model bases its predictions on relevant anatomical features, demonstrating promise for deployment in clinical screening and triage settings.
From Explainable to Explained AI: Ideas for Falsifying and Quantifying Explanations
Schirris, Yoni, Marcus, Eric, Teuwen, Jonas, Horlings, Hugo, Gavves, Efstratios
Explaining deep learning models is essential for clinical integration of medical image analysis systems. A good explanation highlights if a model depends on spurious features that undermines generalization and harms a subset of patients or, conversely, may present novel biological insights. Although techniques like GradCAM can identify influential features, they are measurement tools that do not themselves form an explanation. We propose a human-machine-VLM interaction system tailored to explaining classifiers in computational pathology, including multi-instance learning for whole-slide images. Our proof of concept comprises (1) an AI-integrated slide viewer to run sliding-window experiments to test claims of an explanation, and (2) quantification of an explanation's predictiveness using general-purpose vision-language models. The results demonstrate that this allows us to qualitatively test claims of explanations and can quantifiably distinguish competing explanations. This offers a practical path from explainable AI to explained AI in digital pathology and beyond. Code and prompts are available at https://github.com/nki-ai/x2x.
Interpreting Agent Behaviors in Reinforcement-Learning-Based Cyber-Battle Simulation Platforms
Claypoole, Jared, Cheung, Steven, Gehani, Ashish, Yegneswaran, Vinod, Ridley, Ahmad
We analyze two open source deep reinforcement learning agents submitted to the CAGE Challenge 2 cyber defense challenge, where each competitor submitted an agent to defend a simulated network against each of several provided rules-based attack agents. We demonstrate that one can gain interpretability of agent successes and failures by simplifying the complex state and action spaces and by tracking important events, shedding light on the fine-grained behavior of both the defense and attack agents in each experimental scenario. By analyzing important events within an evaluation episode, we identify patterns in infiltration and clearing events that tell us how well the attacker and defender played their respective roles; for example, defenders were generally able to clear infiltrations within one or two timesteps of a host being exploited. By examining transitions in the environment's state caused by the various possible actions, we determine which actions tended to be effective and which did not, showing that certain important actions are between 40% and 99% ineffective. We examine how decoy services affect exploit success, concluding for instance that decoys block up to 94% of exploits that would directly grant privileged access to a host. Finally, we discuss the realism of the challenge and ways that the CAGE Challenge 4 has addressed some of our concerns.
Israel kills Hamas commander who led heinous Oct. 7 attack on Kibbutz Nir Oz killed in drone attack: IDF
Aviva Siegel, who was held hostage by Hamas for 51 days, tells'Fox & Friends' about her husband, who is still being held in captivity in Gaza, and recounts the harrowing experiences she witnessed during the terror attacks of Oct. 7, 2023. A top Hamas commander responsible for the heinous Oct. 7 attack on Kibbutz Nir Oz has been killed by a targeted drone strike, the Israel Defense Force (IDF) announced. Abd al-Hadi Sabah, who led the infiltration into Kibbutz Nir Oz, which ravaged the community near the Gaza border on Oct. 7, was killed on Tuesday local time in the Western Khan Yunis Battalion. The IDF said in a release on social media Tuesday that they conducted the intelligence-based strike alongside the Israeli Security Agency (ISA). The agencies said that Sabah was hiding in a shelter in the designated humanitarian area in Khan Yunis, in southern Gaza.
Deep Learning for Fetal Inflammatory Response Diagnosis in the Umbilical Cord
Ayad, Marina A., Nateghi, Ramin, Sharma, Abhishek, Chillrud, Lawrence, Seesillapachai, Tilly, Cooper, Lee A. D., Goldstein, Jeffery A.
Inflammation of the umbilical cord can be seen as a result of ascending intrauterine infection or other inflammatory stimuli. Acute fetal inflammatory response (FIR) is characterized by infiltration of the umbilical cord by fetal neutrophils, and can be associated with neonatal sepsis or fetal inflammatory response syndrome. Recent advances in deep learning in digital pathology have demonstrated favorable performance across a wide range of clinical tasks, such as diagnosis and prognosis. In this study we classified FIR from whole slide images (WSI). We digitized 4100 histological slides of umbilical cord stained with hematoxylin and eosin(H&E) and extracted placental diagnoses from the electronic health record. We build models using attention-based whole slide learning models. We compared strategies between features extracted by a model (ConvNeXtXLarge) pretrained on non-medical images (ImageNet), and one pretrained using histopathology images (UNI). We trained multiple iterations of each model and combined them into an ensemble. The predictions from the ensemble of models trained using UNI achieved an overall balanced accuracy of 0.836 on the test dataset. In comparison, the ensembled predictions using ConvNeXtXLarge had a lower balanced accuracy of 0.7209. Heatmaps generated from top accuracy model appropriately highlighted arteritis in cases of FIR 2. In FIR 1, the highest performing model assigned high attention to areas of activated-appearing stroma in Wharton's Jelly. However, other high-performing models assigned attention to umbilical vessels. We developed models for diagnosis of FIR from placental histology images, helping reduce interobserver variability among pathologists. Future work may examine the utility of these models for identifying infants at risk of systemic inflammatory response or early onset neonatal sepsis.
Prompting Whole Slide Image Based Genetic Biomarker Prediction
Zhang, Ling, Yun, Boxiang, Xie, Xingran, Li, Qingli, Li, Xinxing, Wang, Yan
Prediction of genetic biomarkers, e.g., microsatellite instability and BRAF in colorectal cancer is crucial for clinical decision making. In this paper, we propose a whole slide image (WSI) based genetic biomarker prediction method via prompting techniques. Our work aims at addressing the following challenges: (1) extracting foreground instances related to genetic biomarkers from gigapixel WSIs, and (2) the interaction among the fine-grained pathological components in WSIs. Specifically, we leverage large language models to generate medical prompts that serve as prior knowledge in extracting instances associated with genetic biomarkers. We adopt a coarse-to-fine approach to mine biomarker information within the tumor microenvironment. This involves extracting instances related to genetic biomarkers using coarse medical prior knowledge, grouping pathology instances into fine-grained pathological components and mining their interactions. Experimental results on two colorectal cancer datasets show the superiority of our method, achieving 91.49% in AUC for MSI classification. The analysis further shows the clinical interpretability of our method.
A Logical Pattern Memory Pre-trained Model for Entailment Tree Generation
Yuan, Li, Cai, Yi, Ren, Haopeng, Wang, Jiexin
Generating coherent and credible explanations remains a significant challenge in the field of AI. In recent years, researchers have delved into the utilization of entailment trees to depict explanations, which exhibits a reasoning process of how a hypothesis is deduced from the supporting facts. However, existing models often overlook the importance of generating intermediate conclusions with logical consistency from the given facts, leading to inaccurate conclusions and undermining the overall credibility of entailment trees. To address this limitation, we propose the logical pattern memory pre-trained model (LMPM). LMPM incorporates an external memory structure to learn and store the latent representations of logical patterns, which aids in generating logically consistent conclusions. Furthermore, to mitigate the influence of logically irrelevant domain knowledge in the Wikipedia-based data, we introduce an entity abstraction approach to construct the dataset for pre-training LMPM. The experimental results highlight the effectiveness of our approach in improving the quality of entailment tree generation. By leveraging logical entailment patterns, our model produces more coherent and reasonable conclusions that closely align with the underlying premises.
Generating counterfactual explanations of tumor spatial proteomes to discover effective strategies for enhancing immune infiltration
Wang, Zitong Jerry, Xu, Alexander M., Bhargava, Aman, Thomson, Matt W.
While therapies for altering the immune composition, including immunotherapies, have shown exciting results for treating hematological cancers, they are less effective for immunologically-cold, solid tumors. Spatial omics technologies capture the spatial organization of the TME with unprecedented molecular detail, revealing the relationship between immune cell localization and molecular signals. Here, we formulate T-cell infiltration prediction as a self-supervised machine learning problem and develop a counterfactual optimization strategy that leverages large scale spatial omics profiles of patient tumors to design tumor perturbations predicted to boost T-cell infiltration. A convolutional neural network predicts T-cell distribution based on signaling molecules in the TME provided by imaging mass cytometry. Gradient-based counterfactual generation, then, computes perturbations predicted to boost T-cell abundance. We apply our framework to melanoma, colorectal cancer (CRC) liver metastases, and breast tumor data, discovering combinatorial perturbations predicted to support T-cell infiltration across tens to hundreds of patients. This work presents a paradigm for counterfactual-based prediction and design of cancer therapeutics using spatial omics data.
Machine Learning Tool Advances Research on Rheumatoid and Osteoarthritis
A team led by investigators at the Hospital for Special Surgery (HSS) in New York City reports that their computer vision tool effectively distinguishes rheumatoid arthritis (RA) from osteoarthritis (OA) in joint tissue taken from patients who underwent total knee replacement (TKR). The results suggest the machine learning model will help improve research processes in the short term and optimize patient care in the future, according to the researchers who presented their findings at the European Alliance of Associations for Rheumatology (EULAR) Congress 2022 in Copenhagen, Denmark. TKR is often the only management option for patients with severe knee joint damage, the scientists said, who added that identifying which disease caused the joint damage is essential for guiding treatment plans, given that RA is a systemic, inflammatory disease that may also affect the eyes or lining around the heart, while OA affects just the joints. "We know there are many more immune cells present in the synovium, or joint tissue, of patients with RA compared to those with OA," said Bella Mehta, MBBS, rheumatologist at HSS. "But precisely how many more has not been clear." "Pathologists typically assess images of synovium to determine the extent of inflammation using a combination of approaches, including assigning the level of immune cell infiltration on a scale from 0 to 4," noted Dana Orange, MD, rheumatologist at HSS, and assistant professor at Rockefeller University.
Artificial Intelligence In The Cannabis Industry: From Production To Security And Distribution. - Benzinga
AI is just about everywhere these days. It simplifies and expedites processes that would otherwise be done manually. Though once an exotic term of science fiction, it's now what greets you the moment you interact with the customer service page of any major retailer. It should be no surprise that AI has entered the cannabis sphere. Artificial intelligence has the capacity to boost production, improve efficiency, and even make the entire process more environmentally friendly.