MA-RLHF: Reinforcement Learning from Human Feedback with Macro Actions