Can This Tiny Language Model Defeat Gigantic GPT3?