Where does In-context Learning Happen in Large Language Models?