Targeting the Core: A Simple and Effective Method to Attack RAG-based Agents via Direct LLM Manipulation