Goto

Collaborating Authors

 gaddafi


LongFaith: Enhancing Long-Context Reasoning in LLMs with Faithful Synthetic Data

Yang, Cehao, Lin, Xueyuan, Xu, Chengjin, Jiang, Xuhui, Ma, Shengjie, Liu, Aofan, Xiong, Hui, Guo, Jian

arXiv.org Artificial Intelligence

Despite the growing development of long-context large language models (LLMs), data-centric approaches relying on synthetic data have been hindered by issues related to faithfulness, which limit their effectiveness in enhancing model performance on tasks such as long-context reasoning and question answering (QA). These challenges are often exacerbated by misinformation caused by lack of verification, reasoning without attribution, and potential knowledge conflicts. We propose LongFaith, a novel pipeline for synthesizing faithful long-context reasoning instruction datasets. By integrating ground truth and citation-based reasoning prompts, we eliminate distractions and improve the accuracy of reasoning chains, thus mitigating the need for costly verification processes. We open-source two synthesized datasets, LongFaith-SFT and LongFaith-PO, which systematically address multiple dimensions of faithfulness, including verified reasoning, attribution, and contextual grounding. Extensive experiments on multi-hop reasoning datasets and LongBench demonstrate that models fine-tuned on these datasets significantly improve performance. Our ablation studies highlight the scalability and adaptability of the LongFaith pipeline, showcasing its broad applicability in developing long-context LLMs.


Six unforgettable UN General Assembly moments

Al Jazeera

Washington, DC – Since its first session in 1946, the United Nations General Assembly (UNGA) has served as a platform for world leaders and diplomats to spell out their countries' priorities and offer assessments of the problems and needs of humanity. UNGA meetings, particularly the general debate, have brought sworn enemies to the same building and allowed some of the United States' most hostile adversaries to visit New York, where the UN headquarters are located. As the assembly convenes for its annual session this week, here's a look at some unforgettable, and sometimes comical, UNGA moments. After more than four decades in power, the late Libyan leader Muammar Gaddafi made it to the UN podium in 2009. And it was a debut to remember.


Can young robotics fans unite a troubled Libya?

Al Jazeera

Youssef Jira, a fresh-faced 18-year-old in a hoodie with a bandana around his head, has big ambitions in a Libyan society where dictatorship and violence has dominated, rather than youthful creativity. Jira is one of a group of young tech fanatics who took part in the Libya Regional Championship for robotics in a suburb of Tripoli this month. Some 20 teams of 12-to-18-year-olds competed in the inclusive event. He wants to encourage other young people to use hi-tech to help modernise the divided and conflict-scarred country. "We want to send a message to the whole of society, because what we've learned has changed us a lot," Jira said, adding that he has gained new skills and learned about teamwork in pursuit of a common goal.