Large Language Model
SciCode: A Research Coding Benchmark Curated by Scientists
Because LMs now surpass the performance of most humans except domain experts, evaluating them becomes increasingly challenging.
Learning Human-like Representations to Enable Learning Human Values Andrea H. Wynn
How can we build AI systems that can learn any set of individual human values both quickly and safely, avoiding causing harm or violating societal standards for acceptable behavior during the learning process? We explore the effects of representational alignment between humans and AI agents on learning human values.
Checklist
The"other category" included hallucinations, repetitiveoutputs, and symbol mapping errors.
Hints-In-Browser: Benchmarking Language Models for Programming Feedback Generation
Generative AI and large language models hold great promise in enhancing programming education by generating individualized feedback and hints for learners. Recent works have primarily focused on improving the quality of generated feedback to achieve human tutors' quality.