Improved Protein–Ligand Binding Affinity Prediction with Structure-Based Deep Fusion Inference