A Concept-Based Explainability Framework for Large Multimodal Models

Large multimodal models (LMMs) combine unimodal encoders and large language models (LLMs) to perform multimodal tasks.