MedCoAct: Confidence-Aware Multi-Agent Collaboration for Complete Clinical Decision

Abstract--Autonomous agents utilizing Large Language Models (LLMs) have demonstrated remarkable capabilities in isolated medical tasks like diagnosis and image analysis, but struggle with integrated clinical workflows that connect diagnostic reasoning and medication decisions. We identify a core limitation: existing medical AI systems process tasks in isolation without the cross-validation and knowledge integration found in clinical teams, reducing their effectiveness in real-world healthcare scenarios. T o transform the isolation paradigm into a collaborative approach, we propose MedCoAct, a confidence-aware multi-agent framework that simulates clinical collaboration by integrating specialized doctor and pharmacist agents, and present a benchmark, DrugCareQA, to evaluate medical AI capabilities in integrated diagnosis and treatment workflows. Our results demonstrate that MedCoAct achieves 67.58% diagnostic accuracy and 67.58% medication recommendation accuracy, outperforming single agent framework by 7.04% and 7.08% respectively. In healthcare, LLMs have demonstrated capabilities across diverse applications. Medical question-answering systems provide rapid access to comprehensive clinical knowledge and evidence-based recommendations [1]-[3]. LLMs assist also with medical imaging report generation, significantly reducing physician workload [4]. Moreover, LLMs help drug discovery research by accelerating molecular design and optimization processes [5].