Hierarchical Solution of Markov Decision Processes using Macro-actions