Assessment & Standards

Computer says no: why making AIs fair, accountable and transparent is crucial


In October, American teachers prevailed in a lawsuit with their school district over a computer program that assessed their performance. The system rated teachers in Houston by comparing their students' test scores against state averages. Those with high ratings won praise and even bonuses. Those who fared poorly faced the sack. The program did not please everyone.

Push to have robots mark NAPLAN tests under fire from prominent US academic


From next year, NAPLAN persuasive writing tasks will be marked by an automated essay scoring system. Dr Perelman, a former director of writing at MIT, has published widely on writing assessment and was commissioned by the NSW Teacher's Federation to review a 2015 paper by the Australian Curriculum and Assessment Authority (ACARA) that concluded automated essay scoring was as effective, if not more so, than human markers. "ACARA's extensive research indicates automated marking is as reliable and valid as human marking," Dr Rabinowitz said. NSW Teacher's Federation acting president Gary Zadkovich called on ACARA to suspend its plan to introduce automated essay scoring.

How artificial intelligence is transforming learning


Shalina Chatlani writing for Education Dive explains, "The education technology market is growing rapidly and expected to hit $252 billion globally by 2020, according to the 2017 Kahoot! The good news is, it is going after the most intractable problems we have all faced in the education system: college application processes, continuing education, peer to peer study guides, and yes, standardized test preparation. "Most independent schools require standardized test scores from either the ISEE or the SSAT as part of the application. But improved test prep technology isn't just about getting kids to score better on standardized tests.

R-NET: Machine Reading Comprehension with Self-matching Networks - Microsoft Research


In this paper, we introduce R-NET, an end-to-end neural networks model for reading comprehension style question answering, which aims to answer questions from a given passage. We first match the question and passage with gated attention-based recurrent networks to obtain the question-aware passage representation. Then we propose a self-matching attention mechanism to refine the representation by matching the passage against itself, which effectively encodes information from the whole passage. We conduct extensive experiments on the SQuAD and MS-MARCO datasets, and our model achieves the best results on both datasets among all published results.

Job Losses Hurt How A Community's Children Perform In School, Study Says

International Business Times

Plenty of research has documented the adverse impact of a parent's sudden job loss on the average child, in terms of mental health and economic prospects. A 1 percent sudden statewide loss in jobs affects 1.5 percent of students directly -- and indirectly led the remaining 98.5 percent of students to experience "learning losses ... that are about one-third the size of those experienced by children whose parents lose jobs." More specifically, that 1 percent job loss lowered the state's eighth-grade math test scores by 0.057 standard deviations, an amount roughly the same size as the increase that results from intervention efforts intended to boost test scores. "What I see as one of the main points in our study is that the effects on people who lost their job or the children of people who lost their jobs -- there are spillover effects," said Dania Francis, one of the study's authors and an assistant professor of economics at the University of Massachusetts at Amherst.

Machine passes EM gaokao /EM math test - China -


A smart machine made by a company in Chengdu, Sichuan province, took the math test of the national college entrance examination, or gaokao, on Wednesday. AI-MATHS is an artificial intelligence program developed in 2014, based on cutting-edge big data technology, artificial intelligence and natural language recognition from Tsinghua University. Before Wednesday's test, the developer had the machine answer 12,000 math questions to improve its logical reasoning and computer algorithms. In February, AI-MATHS took a math test with Grade 3 students at Chengdu Shishi Tianfu High School and scored 93, slightly higher than the passing grade of 90.

Will robots soon be conducting pupil-assessments?


So what might an alternative education assessment system, based on Artificial Intelligence, actually look like? Rose Luckin argues that nowadays AI is capable of "forming an evaluation of each student's progress (…) over a period of time." AI techniques, such as computer modelling and machine learning, would then be applied to this information and the AI assessment system would form an evaluation of the student's knowledge of the subject area being studied. Based on this data, the software system guides each student towards the solution to each problem, providing hints and tips geared to the student's individual profile.

Could AI Replace Student Testing? - Motherboard


Technology exists to build realistic education assessments based on artificial intelligence in which students can be evaluated individually and at deep, fine-grained scales. "AI techniques, such as computer modeling and machine learning, are applied to this information and the AI assessment system forms an evaluation of the student's knowledge of the subject area being studied," Luckin explains. If we are to build scaled AI assessment systems that will be welcomed by students, teachers and parents, it will be essential to work with educators and system developers to specify data standards that prioritize both the sharing of data and the ethics underlying data use." Maybe there's some way of starting small, wherein existing student data is used for building learning models and individualizing curricula.

Towards artificial intelligence-based assessment systems


In order to open this black box of learning, AI assessment systems need information about: (1) the curriculum, subject area and learning activities that each student is completing; (2) the details of the steps each student takes as they complete these activities; and (3) what counts as success within each of these activities and within each of the steps towards the completion of each activity. Specifically, it collects data about each step the student takes towards a task solution, the amount of hints or tips that the student requires to successfully complete each step and each task, and the difficulty level of each task the student completes. The AIAssess Student Model Component uses outputs from the Analytics Component to strengthen or weaken its judgement about every student's: Knowledge and understanding of each concept in a mathematics or science curriculum, by assessing each student's ability to complete a solution step, or entire task, correctly without any hints or tips. Potential for development in their knowledge and understanding of each concept in a mathematics or science curriculum, by assessing each student's ability to complete a solution step, or entire task, correctly with a particular level of hints or tips.

News site makes readers answer questions to prove they understand story before posting comments

The Independent

The giant human-like robot bears a striking resemblance to the military robots starring in the movie'Avatar' and is claimed as a world first by its creators from a South Korean robotic company Waseda University's saxophonist robot WAS-5, developed by professor Atsuo Takanishi and Kaptain Rock playing one string light saber guitar perform jam session A man looks at an exhibit entitled'Mimus' a giant industrial robot which has been reprogrammed to interact with humans during a photocall at the new Design Museum in South Kensington, London Electrification Guru Dr. Wolfgang Ziebart talks about the electric Jaguar I-PACE concept SUV before it was unveiled before the Los Angeles Auto Show in Los Angeles, California, U.S The Jaguar I-PACE Concept car is the start of a new era for Jaguar. Japan's On-Art Corp's CEO Kazuya Kanemaru poses with his company's eight metre tall dinosaur-shaped mechanical suit robot'TRX03' and other robots during a demonstration in Tokyo, Japan Japan's On-Art ...