Studying LLM Performance on Closed- and Open-source Data