Goto

Collaborating Authors

 epithelial cell



WSI-LLaVA: A Multimodal Large Language Model for Whole Slide Image

Liang, Yuci, Lyu, Xinheng, Ding, Meidan, Chen, Wenting, Zhang, Jipeng, Ren, Yuexiang, He, Xiangjian, Wu, Song, Yang, Sen, Wang, Xiyue, Xing, Xiaohan, Shen, Linlin

arXiv.org Artificial Intelligence

Recent advancements in computational pathology have produced patch-level Multi-modal Large Language Models (MLLMs), but these models are limited by their inability to analyze whole slide images (WSIs) comprehensively and their tendency to bypass crucial morphological features that pathologists rely on for diagnosis. To address these challenges, we first introduce WSI-Bench, a large-scale morphology-aware benchmark containing 180k VQA pairs from 9,850 WSIs across 30 cancer types, designed to evaluate MLLMs' understanding of morphological characteristics crucial for accurate diagnosis. Building upon this benchmark, we present WSI-LLaVA, a novel framework for gigapixel WSI understanding that employs a three-stage training approach: WSI-text alignment, feature space alignment, and task-specific instruction tuning. To better assess model performance in pathological contexts, we develop two specialized WSI metrics: WSI-Precision and WSI-Relevance. Experimental results demonstrate that WSI-LLaVA outperforms existing models across all capability dimensions, with a significant improvement in morphological analysis, establishing a clear correlation between morphological understanding and diagnostic accuracy.


Immunohistochemistry guided segmentation of benign epithelial cells, in situ lesions, and invasive epithelial cells in breast cancer slides

Høibø, Maren, Pedersen, André, Dale, Vibeke Grotnes, Berget, Sissel Marie, Ytterhus, Borgny, Lindskog, Cecilia, Wik, Elisabeth, Akslen, Lars A., Reinertsen, Ingerid, Smistad, Erik, Valla, Marit

arXiv.org Artificial Intelligence

Digital pathology enables automatic analysis of histopathological sections using artificial intelligence (AI). Automatic evaluation could improve diagnostic efficiency and help find associations between morphological features and clinical outcome. For development of such prediction models, identifying invasive epithelial cells, and separating these from benign epithelial cells and in situ lesions would be the first step. In this study, we aimed to develop an AI model for segmentation of epithelial cells in sections from breast cancer. We generated epithelial ground truth masks by restaining hematoxylin and eosin (HE) sections with cytokeratin (CK) AE1/AE3, and by pathologists' annotations. HE/CK image pairs were used to train a convolutional neural network, and data augmentation was used to make the model more robust. Tissue microarrays (TMAs) from 839 patients, and whole slide images from two patients were used for training and evaluation of the models. The sections were derived from four cohorts of breast cancer patients. TMAs from 21 patients from a fifth cohort was used as a second test set. In quantitative evaluation, a mean Dice score of 0.70, 0.79, and 0.75 for invasive epithelial cells, benign epithelial cells, and in situ lesions, respectively, were achieved. In qualitative scoring (0-5) by pathologists, results were best for all epithelium and invasive epithelium, with scores of 4.7 and 4.4. Scores for benign epithelium and in situ lesions were 3.7 and 2.0. The proposed model segmented epithelial cells in HE stained breast cancer slides well, but further work is needed for accurate division between the classes. Immunohistochemistry, together with pathologists' annotations, enabled the creation of accurate ground truths. The model is made freely available in FastPathology and the code is available at https://github.com/AICAN-Research/breast-epithelium-segmentation


Machine learning technique helps identify cancer cell types

#artificialintelligence

IMAGE: Brown researchers have trained a computer algorithm to spot in laboratory samples a cellular transition associated with more aggressive cancers. Brown University researchers have developed a new image analysis technique to distinguish two key cancer cell types associated with tumor progression. The approach could help in pre-clinical screening of cancer drugs and shed light on a cellular metamorphosis that is associated with more malignant and drug-resistant cancers. The epithelial-mesenchymal transition, or EMT, is a process by which more docile epithelial cells transform into more aggressive mesenchymal cells. Tumors with higher numbers of mesenchymal cells are often more malignant and more resistant to drug therapies.


Machine learning technique helps identify cancer cell types

#artificialintelligence

Brown University researchers have developed a new image analysis technique to distinguish two key cancer cell types associated with tumor progression. The approach could help in pre-clinical screening of cancer drugs and shed light on a cellular metamorphosis that is associated with more malignant and drug-resistant cancers. The epithelial-mesenchymal transition, or EMT, is a process by which more docile epithelial cells transform into more aggressive mesenchymal cells. Tumors with higher numbers of mesenchymal cells are often more malignant and more resistant to drug therapies. The new technique combines microscopic imaging with a machine learning algorithm to better identify and distinguish between the two cell types in laboratory samples.