A Deep Dive into the Trade-Offs of Parameter-Efficient Preference Alignment Techniques