Fast and Regret Optimal Best Arm Identification: Fundamental Limits and Low-Complexity Algorithms