This advancement in natural language processing technology has significantly improved the functionality of conversational systems. Focusing more on language model development has spurred significant progress in understanding and generating human language, pushing the boundaries of machine interaction. This breakthrough primarily involves the enhancement of text-based applications, demonstrating how AI can more effectively comprehend, interpret, and respond to human language. This shift has had a profound impact on various sectors, ranging from customer service automation to sophisticated data analysis, emphasizing the transformative power of advanced language models in AI. Due to the success of ChatGPT, the training strategy of fine-tuning with instructions[2] has also been endorsed by researchers in the language model domain.