Research towards creating systems for automatic grading of student answers to quiz and exam questions in educational settings has been ongoing since 1966. Over the years, the problem was divided into many categories. Among them, grading text answers were divided into short answer grading, and essay grading. The goal of this work was to develop an ML-based short answer grading system. I hence built a system which uses finetuning on Roberta Large Model pretrained on STS benchmark dataset and have also created an interface to show the production readiness of the system. I evaluated the performance of the system on the Mohler extended dataset and SciEntsBank Dataset. The developed system achieved a Pearsons Correlation of 0.82 and RMSE of 0.7 on the Mohler Dataset which beats the SOTA performance on this dataset which is correlation of 0.805 and RMSE of 0.793. Additionally, Pearsons Correlation of 0.79 and RMSE of 0.56 was achieved on the SciEntsBank Dataset, which only reconfirms the robustness of the system. A few observations during achieving these results included usage of batch size of 1 produced better results than using batch size of 16 or 32 and using huber loss as loss function performed well on this regression task. The system was tried and tested on train and validation splits using various random seeds and still has been tweaked to achieve a minimum of 0.76 of correlation and a maximum 0.15 (out of 1) RMSE on any dataset.
Decades of research in artificial intelligence (AI) have produced formidable technologies that are providing immense benefit to industry, government, and society. AI systems can now translate across multiple languages, identify objects in images and video, streamline manufacturing processes, and control cars. The deployment of AI systems has not only created a trillion-dollar industry that is projected to quadruple in three years, but has also exposed the need to make AI systems fair, explainable, trustworthy, and secure. Future AI systems will rightfully be expected to reason effectively about the world in which they (and people) operate, handling complex tasks and responsibilities effectively and ethically, engaging in meaningful communication, and improving their awareness through experience. Achieving the full potential of AI technologies poses research challenges that require a radical transformation of the AI research enterprise, facilitated by significant and sustained investment. These are the major recommendations of a recent community effort coordinated by the Computing Community Consortium and the Association for the Advancement of Artificial Intelligence to formulate a Roadmap for AI research and development over the next two decades.
Udemy Online Course - Deep learning Calculus - Data Science - Machine Learning AI Mastering Calculus for Deep learning / Machine learning / Data Science / Data Analysis / AI using Python You start by learning the definition of function and move your way up for fitting the data to the function which is the core for any Machine learning, Deep Learning, Artificial intelligence, Data Science Application. Once you have mastered the concepts of this course, you will never be blind while applying the algorithm to your data, instead you have the intuition as how each code is working in background. What you'll learn Build Mathematical intuition especially Calculus required for Deep learning, Data Science and Machine Learning The Calculus intuition required to become a Data Scientist / Machine Learning / Deep learning Practitioner How to take their Data Science / Machine Learning / Deep learning career to the next level Hacks, tips & tricks for their Data Science / Machine Learning / Deep learning career Implement Machine Learning / Deep learning Algorithms better Learn core concept to Implement in Machine Learning / Deep learning Who this course is for: Data Scientists who wish to improve their career in Data Science. Deep learning / Machine learning practitioner who wants to take the career to next level Any one who wants to understand the underpinnings of Maths in Data Science, Machine Learning, Deep Learning and Artificial intelligence Any Data Science / Machine Learning / Deep learning enthusiast Any student or professional who wants to start or transition to a career in Data Science / Machine Learning / Deep learning Students who want to refresh and learn important maths concepts required for Machine Learning, Deep Learning & Data Science. Data Scientists who wish to improve their career in Data Science.