The field of natural language processing (NLP) has been transformed by massive pre-trained language models. They form the basis of all state-of-the-art systems across a wide range of tasks and have shown an impressive ability to generate fluent text and perform few-shot learning. At the same time, these models are hard to understand and give rise to new ethical and scalability challenges. In this course, students will learn the fundamentals about the modeling, theory, ethics, and systems aspects of large language models, as well as gain hands-on experience working with them. Where: Class will by default be in person at 200-002 (History Corner).

When you join Turnitin, you'll be welcomed into a company that is a recognized innovator in the global education space. For more than 20 years, Turnitin has partnered with educational institutions to promote honesty, consistency, and fairness across all subject areas and assessment types. Over 16,000 academic institutions, publishers, and corporations use our services: Gradescope by Turnitin, iThenticate, Turnitin Feedback Studio, Turnitin Originality, Turnitin Similarity, ExamSoft, and ProctorExam. Turnitin has offices in Australia, India, Indonesia, Japan, Korea, Mexico, the Netherlands, the Philippines, Ukraine, the United Kingdom, and the United States. Our diverse community of colleagues are all unified by a shared desire to make a difference in education.

Nothing seemed suspect when Jill Watson, a teaching assistant at the Georgia Institute of Technology (Georgia Tech), emailed students about assignments and answered questions during Professor Ashok Goel's online knowledge-based artificial intelligence course. In fact, it wasn't until the end of the semester that the students realized they hadn't been emailing a human at all -- they'd been corresponding with a chatbot. Goel had built an artificially intelligent teaching assistant that could answer routine questions so that he and the human teaching assistants could focus on responding to more complex issues, Business Insider reports. And he isn't the only person using artificial intelligence to improve education. The teams at companies including Thinkster Math, Brainly, Content Technologies Inc., and Gradescope are creating artificial intelligence tools to aid students and educators.

We are teaching a major update of the course Spring 2021 as an official UC Berkeley course and as an online course, with all lectures and labs available for free. There are many great courses to learn how to train deep neural networks. However, training the model is just one part of shipping a deep learning project. The course is aimed at people who already know the basics of deep learning and want to understand the rest of the process of creating production deep learning systems. While we cover the basics of deep learning (backpropagation, convolutional neural networks, recurrent neural networks, transformers, etc), we expect these lectures to be mostly review.

Now more than ever, our teachers need help. Faced with an unprecedented crisis of having to move all instruction online in a matter of weeks, everyone is figuring out the new playbook for teaching in the 21st century. Here is artificial intelligence, and education -- AI won't fix education, but it can help. One of the topics discussed, alongside video chats, online quizzes, and remote attendance is artificial intelligence. Indeed, it's time to take a closer look at how AI can be helpful to our instructors today.

Nothing seemed suspect when Jill Watson, a teaching assistant at the Georgia Institute of Technology (Georgia Tech), emailed students about assignments and answered questions during Professor Ashok Goel's online knowledge-based artificial intelligence course. In fact, it wasn't until the end of the semester that the students realized they hadn't been emailing a human at all -- they'd been corresponding with a chatbot. Goel had built an artificially intelligent teaching assistant that could answer routine questions so that he and the human teaching assistants could focus on responding to more complex issues, Business Insider reports. And he isn't the only person using artificial intelligence to improve education. The teams at companies including Thinkster Math, Brainly, Content Technologies Inc., and Gradescope are creating artificial intelligence tools to aid students and educators.

Instructors returning to high school and college classes this fall, take note: Grading your students' work is about to get a lot easier. A UC Berkeley professor and three former graduate students are putting the finishing touches on an artificial intelligence technology that groups answers and allows them to be graded en masse. The AI-boosted capability, now wrapping up beta testing before becoming available this fall, will be the newest feature of the online grading application Gradescope. The team launched the app as a company two years ago, in part to stem cheating. Having a digital record of a graded paper makes it hard to alter written answers and argue the paper was incorrectly graded.

We call it "AI-assisted grading," where machines assist humans in grading consistently and quickly. For many questions, Gradescope's AI will be able to learn how to grade all student submissions from a small number of answers graded by the instructor, such that an instructor would only have to grade about ten answers out of a hundred submissions. For known questions, Gradescope's AI will be able to grade instantly, without any human input. This seems to be the evolving narrative of man and machine, collaborating together for the greater good, software and robots becoming "partners" in work rather than usurpers of it. And for the time stressed teacher or teaching assistant, having to "grade" ten essays instead of hundreds is certainly appealing.

Gradescope, which has graded millions of exam questions, has made the grade itself. The company has raised a 2.6 million round of funding from Freestyle Capital, Bloomberg Beta, Reach Capital and the House Fund. Existing investor K9 Ventures also participated. Dave Samuel from Freestyle will be joining Manu Kumar from K9 Ventures on Gradescope's board. The company, started as a side project at the University of California Berkeley in 2012, makes a software that helps science and engineering professors and teaching assistants grade exam questions on handwritten tests.