Global Benchmark Database
–arXiv.org Artificial Intelligence
This paper presents Global Benchmark Database (GBD), a comprehensive suite of tools for provisioning and sustainably maintaining benchmark instances and their metadata. The availability of benchmark metadata is essential for many tasks in empirical research, e.g., for the data-driven compilation of benchmarks, the domain-specific analysis of runtime experiments, or the instance-specific selection of solvers. In this paper, we introduce the data model of GBD as well as its interfaces and provide examples of how to interact with them. We also demonstrate the integration of custom data sources and explain how to extend GBD with additional problem domains, instance formats and feature extractors.
arXiv.org Artificial Intelligence
Jun-27-2024
- Country:
- North America
- United States > California (0.04)
- Canada > Ontario
- Toronto (0.04)
- Europe
- Germany > Baden-Württemberg
- Karlsruhe Region > Karlsruhe (0.04)
- Finland > Uusimaa
- Helsinki (0.04)
- Germany > Baden-Württemberg
- North America
- Genre:
- Research Report (0.40)
- Technology:
- Information Technology
- Artificial Intelligence (1.00)
- Information Management (0.93)
- Data Science (0.68)
- Information Technology