Allen Institute for AI Announces BERT-Breakthrough: Passing an 8th-Grade Science Exam - NVIDIA Developer News Center

This week the Allen Institute for Artificial Intelligence announced a breakthrough for a BERT-based model, passing an eighth-grade science test. The GPU-accelerated system called Aristo can read, learn, and reason about science, in this case emulating the decision making of students. For this milestone, Aristo answered more than 90 percent of the questions on an eighth-grade science exam correctly, and 83 percent on a 12th-grade exam. "Although Aristo only answers multiple choice questions without diagrams, and operates only in the domain of science, it nevertheless represents an important milestone towards systems that can read and understand," the researchers stated in a newly published paper on ArXiv. "The momentum on this task has been remarkable, with accuracy moving from roughly 60% to over 90% in just three years," Though no diagrams were used for this particular task, the work as a whole integrates multiple AI-based technologies including natural language processing, information extraction, knowledge representation and reasoning, commonsense knowledge, and diagram understanding.