SciCode: A Research Coding Benchmark Curated by Scientists

Oct-9-2025, 23:14:50 GMT–Neural Information Processing Systems

Because LMs now surpass the performance of most humans except domain experts, evaluating them becomes increasingly challenging.

large language model, machine learning, main problem, (21 more...)

Neural Information Processing Systems

Oct-9-2025, 23:14:50 GMT

Conferences PDF

Country:
- Asia > Japan
  - Honshū
    - Chūbu > Toyama Prefecture
      - Toyama (0.04)
    - Tōhoku > Iwate Prefecture
      - Morioka (0.04)
- Europe
  - Monaco (0.04)
  - United Kingdom > England
    - Cambridgeshire > Cambridge (0.04)
- North America > United States
  - Illinois
    - Champaign County > Urbana (0.04)
    - Cook County > Chicago (0.04)
  - Massachusetts (0.04)
  - North Carolina (0.04)
  - North Dakota > Bowman County (0.04)
  - Texas
    - Schleicher County (0.04)
    - Travis County > Austin (0.04)

Genre:
- Research Report > New Finding (0.46)

Industry:
- Energy (0.67)
- Government > Regional Government
  - North America Government > United States Government (0.46)
- Health & Medicine (0.46)

Technology:
- Information Technology > Artificial Intelligence
  - Machine Learning > Neural Networks
    - Deep Learning (1.00)
  - Natural Language
    - Chatbot (1.00)
    - Large Language Model (1.00)
  - Representation & Reasoning (1.00)