PEDAL: Enhancing Greedy Decoding with Large Language Models using Diverse Exemplars