LLM-Powered Test Case Generation for Detecting Tricky Bugs