360-LLaMA-Factory: Plug & Play Sequence Parallelism for Long Post-Training

Zou, Haosheng, Lv, Xiaowei, Jia, Shousheng, Li, Lin, Gong, Xiaochun, Zhang, Xiangzheng

arXiv.org Artificial Intelligence 

Large Language Models (LLMs) nowadays are expected to process inputs of unprecedented length, with current token limits extending to several million tokens.

Duplicate Docs Excel Report

Title
None found

Similar Docs  Excel Report  more

TitleSimilaritySource
None found