Towards Objective and Unbiased Decision Assessments with LLM-Enhanced Hierarchical Attention Networks