Instruction-Tuning Llama-3-8B Excels in City-Scale Mobility Prediction
Tang, Peizhi, Yang, Chuang, Xing, Tong, Xu, Xiaohang, Jiang, Renhe, Sezaki, Kaoru
–arXiv.org Artificial Intelligence
Human mobility prediction plays a critical role in applications such as disaster response, urban planning, and epidemic forecasting. Traditional methods often rely on designing crafted, domain-specific models, and typically focus on short-term predictions, which struggle to generalize across diverse urban environments. In this study, we introduce Llama-3-8B-Mob, a large language model fine-tuned with instruction tuning, for long-term citywide mobility prediction -- in a Q&A manner. We validate our approach using large-scale human mobility data from four metropolitan areas in Japan, focusing on predicting individual trajectories over the next 15 days. The results demonstrate that Llama-3-8B-Mob excels in modeling long-term human mobility -- surpassing the state-of-the-art on multiple prediction metrics. It also displays strong zero-shot generalization capabilities -- effectively generalizing to other cities even when fine-tuned only on limited samples from a single city. Source codes are available at https://github.com/TANGHULU6/Llama3-8B-Mob.
arXiv.org Artificial Intelligence
Oct-31-2024
- Country:
- Asia
- China > Guangdong Province
- Shenzhen (0.04)
- Japan > Honshū
- Kantō > Tokyo Metropolis Prefecture
- Tokyo (0.18)
- Tōhoku > Fukushima Prefecture
- Fukushima (0.04)
- Kantō > Tokyo Metropolis Prefecture
- China > Guangdong Province
- Europe > Spain
- Basque Country > Biscay Province > Bilbao (0.04)
- North America > United States
- Florida > Miami-Dade County > Miami (0.04)
- Asia
- Genre:
- Research Report > New Finding (0.69)
- Industry:
- Health & Medicine > Epidemiology (0.34)
- Technology: