The Next Frontier of LLM Applications: Open Ecosystems and Hardware Synergy