Enhancing AI Safety Through the Fusion of Low Rank Adapters