The Role of Computing Resources in Publishing Foundation Model Research
Hao, Yuexing, Huang, Yue, Zhang, Haoran, Zhao, Chenyang, Liang, Zhenwen, Liang, Paul Pu, Zhao, Yue, Sun, Lichao, Kalantari, Saleh, Zhang, Xiangliang, Ghassemi, Marzyeh
–arXiv.org Artificial Intelligence
Artificial Intelligence (AI) and machine learning (ML) models have made stark advances in the past three years, fueled by the development of foundation models (FM) trained on large-scale multimodal data. Following the public release of several successful FMs (OpenAI (2022); Brown et al. (2020); Bommasani et al. (2022)), FMs such as large language models (LLMs) and vision language models (VLMs) have bridged vision, language, and other modalities. In many Computer Science subfields such as Natural Language Processing (NLP) and Computer Vision (CV), FMs have demonstrated strong compositional performance and generalization capabilities (Awais et al. (2025); Gunter et al. (2024)), emerging as widely-used tools (Bommasani et al. (2022)) that provide a flexible backbones for innovation in other fields (Moor et al. (2023); Sartor & Thompson (2025); Firoozi et al. (2024)). Conducting FM research requires significant data, computing, and human resources (Cottier et al. (2024); Maslej et al. (2024); Crawford (2024)). A central concern in the field is whether greater access to such resources directly translates into more impactful research outcomes (Acemoglu (2024); Dodge et al. (2019); OpenAI (2018)), such as more research publications, or higher citation counts (Sinclair et al. (2023); Anjum et al. (2019)). The answer to this question has important implications for how resources are allocated, which research directions are prioritized, and how equitable participation in FM research can be ensured. However, the cost of research is often difficult to quantify due to lack of uniform disclosure on resource distribution (Bommasani et al. (2024)). Absent widespread disclosure, funding is perhaps most easily characterized in the concrete cost of purchasing or renting hardware (e.g., computing clusters, or chips), through there are also software, cloud storage services, and specialized software platform costs.
arXiv.org Artificial Intelligence
Oct-16-2025
- Country:
- Asia > China
- Hong Kong (0.04)
- Europe
- North America
- Canada (0.04)
- Mexico > Mexico City
- Mexico City (0.04)
- United States
- Oceania > Australia (0.04)
- Asia > China
- Genre:
- Overview (1.00)
- Questionnaire & Opinion Survey (1.00)
- Research Report > Experimental Study (1.00)
- Industry:
- Information Technology (0.94)
- Social Sector (0.88)
- Technology: