The Inference Cost Of Search Disruption – Large Language Model Cost Analysis

OpenAI's ChatGPT took the world by storm, quickly amassing over 100 million active users in January alone. This is the fastest any application has ever grown to this size, with the prior two record keepers being TikTok at 9 months and Instagram at 2.5 years. The top question on everyone's mind is how disruptive large language models (LLMs) will be for search. Microsoft rocked the world this week with their Bing announcement, incorporating OpenAI's technology into search. This new Bing will make Google come out and dance, and I want people to know that we made them dance.