Country:
- Europe > United Kingdom > England > West Midlands > Coventry (0.04)
- Oceania > Australia (0.04)
- Europe > United Kingdom > England > Cambridgeshire > Cambridge (0.04)
Technology:
InfiBench: Evaluating the Question-Answering Capabilities of Code Large Language Models
With the rapid development of code LLMs, many popular evaluation benchmarks, such as HumanEval, DS-1000, and MBPP, have emerged to measure the performance of code LLMs with a particular focus on code generation tasks. However, they are insufficient to cover the full range of expected capabilities of code LLMs, which span beyond code generation to answering diverse coding-related questions.
Technology:
Country:
- Europe > United Kingdom > England > Cambridgeshire > Cambridge (0.04)
- Asia > China (0.04)
- Asia > Middle East > Iran > Tehran Province > Tehran (0.04)
Genre:
- Research Report > New Finding (1.00)
- Research Report > Experimental Study (0.93)
Technology:
- Information Technology > Artificial Intelligence > Machine Learning > Neural Networks (1.00)
- Information Technology > Communications (0.67)
- Information Technology > Software (0.67)
Country:
- North America > United States > Ohio (0.24)
- North America > Canada > Ontario > Toronto (0.14)
- South America > Chile (0.04)
- (2 more...)
Technology:
Country:
- North America > Canada > Quebec > Montreal (0.04)
- Europe > France > Provence-Alpes-Côte d'Azur > Bouches-du-Rhône > Marseille (0.04)
- Europe > France > Île-de-France (0.04)
- (2 more...)
Genre:
- Research Report > Experimental Study (1.00)
- Research Report > New Finding (0.93)
- Overview (0.67)
Industry:
- Transportation (0.68)
- Government (0.45)
Technology:
Industry:
- Law (0.47)
- Government (0.47)
Technology:
Country:
- Asia > Japan > Honshū > Chūbu > Ishikawa Prefecture > Kanazawa (0.04)
- North America > United States > Pennsylvania > Allegheny County > Pittsburgh (0.04)
- North America > United States > Louisiana > Orleans Parish > New Orleans (0.04)
- North America > United States > Iowa (0.04)
Genre:
- Research Report (0.67)
- Overview (0.46)
Industry:
- Machinery > Industrial Machinery (0.68)
- Information Technology (0.46)
Technology:
Country:
- North America > United States > California > San Francisco County > San Francisco (0.14)
- North America > Mexico > Oaxaca (0.04)
- North America > United States > Nebraska (0.04)
- (4 more...)
Industry:
Technology:
Country:
- North America > United States > Pennsylvania > Philadelphia County > Philadelphia (0.04)
- Asia > Taiwan > Taiwan Province > Taipei (0.04)
- Asia > Japan > Honshū > Kantō > Tokyo Metropolis Prefecture > Tokyo (0.04)
Technology:
- Information Technology > Artificial Intelligence > Vision (1.00)
- Information Technology > Artificial Intelligence > Natural Language (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Neural Networks > Deep Learning (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Statistical Learning (0.68)
Country:
- North America > United States (0.14)
- Asia > China > Beijing > Beijing (0.04)
Industry:
- Information Technology (0.67)
- Government (0.46)
- Education (0.46)
Technology: