However, progress is limited by a lack of standardized datasets and comparison metrics, causing methods to be compared in an ad hoc manner.

Moreover, the model tends to generalize well to unseen tasks that did not appear in the training data.

We create GTA (a benchmark forGeneral Tool Agents) to evaluate the general tool-use ability ofLLMs inreal-worldscenarios. Who created the dataset (e.g., which team, research group) and on behalf of which entity(e.g.,company,institution,organization)?