SciCode: A Research Coding Benchmark Curated by Scientists
–Neural Information Processing Systems
Because LMs now surpass the performance of most humans except domain experts, evaluating them becomes increasingly challenging.
Neural Information Processing Systems
Oct-9-2025, 23:14:50 GMT
- Country:
- Asia > Japan
- Honshū
- Chūbu > Toyama Prefecture
- Toyama (0.04)
- Tōhoku > Iwate Prefecture
- Morioka (0.04)
- Chūbu > Toyama Prefecture
- Honshū
- Europe
- Monaco (0.04)
- United Kingdom > England
- Cambridgeshire > Cambridge (0.04)
- North America > United States
- Illinois
- Champaign County > Urbana (0.04)
- Cook County > Chicago (0.04)
- Massachusetts (0.04)
- North Carolina (0.04)
- North Dakota > Bowman County (0.04)
- Texas
- Schleicher County (0.04)
- Travis County > Austin (0.04)
- Illinois
- Asia > Japan
- Genre:
- Research Report > New Finding (0.46)
- Industry:
- Energy (0.67)
- Government > Regional Government
- Health & Medicine (0.46)
- Technology: