A Comprehensive Graph Framework for Question Answering with Mode-Seeking Preference Alignment