The design of a reward function often poses a major practical challenge to realworld applications of reinforcement learning.

On his videos, Sergey appears fresh-faced and smiling enthusiastically. Speaking in Russian and sometimes in slightly broken English, he goes through coding challenges step-by-step. His YouTube channel has more than 3,500 subscribers, interested in learning programming languages Python and Unity, or who want to hear more about neural networks, which underlie many artificial intelligence tools. Mr Mandik said Sergey showed not only remarkable developer skills but also "equally unique" skills in teaching. "For me, he is kind of a Mozart."

Many times AI has been put on a pedestal as the future of x y & z, however, many seem to agree that education is a sector in particular which will see stark changes in both admin, teaching styles, personalisation and more. I had the pleasure of speaking to three individuals working in the field, including, Vinod Bakthavachalam, Senior Data Scientist at Coursera, Kian Katanforoosh, Lecturer at Stanford University & Sergey Karayev, Co-Founder and CTO of Gradescope. We began by having Sergey of Gradescope walk us through his product, which has been recently acquired by turnitin. The concept, it seemed was formed from the simple and widespread issue of both lack of consistency, lack of insight through time constraint and delayed feedback on academic work. Sergey found that scanning the papers onto an online interface when paired with a rubric can allow for accurate marking in seconds across several papers.

Many times AI has been put on a pedestal as the future of x y & z, however, many seem to agree that education is a sector in particular which will see stark changes in both admin, teaching styles, personalisation and more. I had the pleasure of speaking to three individuals working in the field, including, Vinod Bakthavachalam, Senior Data Scientist at Coursera, Kian Katanforoosh, Lecturer at Stanford University & Sergey Karayev, Co-Founder and CTO of Gradescope. We began by having Sergey of Gradescope walk us through his product, which has been recently acquired by turnitin. The concept, it seemed was formed from the simple and widespread issue of both lack of consistency, lack of insight through time constraint and delayed feedback on academic work. Sergey found that scanning the papers onto an online interface when paired with a rubric can allow for accurate marking in seconds across several papers.

A virtual edition of the International Conference on Autonomous Agents and Multi-Agent Systems (AAMAS) conference was held on 9-13 May. Videos of the talks are now available for public viewing, and you can also see the sessions from the various workshops. Alison is interested in how cities work and builds spatial agent-based models (ABMs) to study how people move around and how behaviour plays out in space and time. There are a number of challenges with these kinds of models and they need to be really robust if they are to be adopted by policy makers. So, why should we be interested in modelling cities?