Large Language Models (LLMs) have gained significant attention in the field of natural language processing (NLP) due to their wide range of applications. However, training LLMs for languages other than English poses significant challenges, due to the difficulty in acquiring large-scale corpus and the requisite computing resources. In this paper, we propose ChatFlow, a cross-language transfer-based LLM, to address these challenges and train large Chinese language models in a cost-effective manner. We employ a mix of Chinese, English, and parallel corpus to continuously train the LLaMA2 model, aiming to align cross-language representations and facilitate the knowledge transfer specifically to the Chinese language model. In addition, we use a dynamic data sampler to progressively transition the model from unsupervised pre-training to supervised fine-tuning. Experimental results demonstrate that our approach accelerates model convergence and achieves superior performance. We evaluate ChatFlow on popular Chinese and English benchmarks, the results indicate that it outperforms other Chinese models post-trained on LLaMA-2-7B.

China's search giant Baidu has made another acquisition to continue its push into artificial intelligence, and specifically to help it carve out a place for itself as a platform for developers who want to create chatbots and other services based on natural language technology. Baidu has acquired Kitt.ai, a profitable startup based out of Seattle that has developed a framework to build and power chatbots and voice-based applications across multiple platforms and devices (presumably named after this Kitt). The deal has been confirmed to us directly by Baidu. It was also announced on stage at Baidu's developer event in Beijing, confirmed in a blog post from Kitt.ai, and also made public with a short note from Baidu on Weibo. Financial terms of the deal are not being disclosed, a Baidu spokesperson said. Kitt.ai has been around since 2014, but it appears that it had only disclosed a seed round of funding of an unspecified size as a startup.

China's search giant Baidu has made another acquisition to continue its push into artificial intelligence, and specifically carving out a place for itself as a platform for developers who want to create chatbots and other services based on natural language technology. It has acquired Kitt.ai, a profitable startup based out of Seattle that has developed a framework to build and power chatbots and voice-based applications across multiple platforms and devices. Terms of the deal -- which was announced on stage at Baidu's developer event in Beijing, and also confirmed in a blog post from Kitt.ai -- are not being disclosed. Kitt.ai has been around since 2014, but it appears that it had only disclosed a seed round of funding of an unspecified size as a startup. Its backers were Amazon's Alexa Fund and the Founders Co-op. Importantly, the company was growing and thriving.