Education
Improved knowledge distillation by utilizing backward pass knowledge in neural networks
Jafari, Aref, Rezagholizadeh, Mehdi, Ghodsi, Ali
Knowledge distillation (KD) is one of the prominent techniques for model compression. In this method, the knowledge of a large network (teacher) is distilled into a model (student) with usually significantly fewer parameters. KD tries to better-match the output of the student model to that of the teacher model based on the knowledge extracts from the forward pass of the teacher network. Although conventional KD is effective for matching the two networks over the given data points, there is no guarantee that these models would match in other areas for which we do not have enough training samples. In this work, we address that problem by generating new auxiliary training samples based on extracting knowledge from the backward pass of the teacher in the areas where the student diverges greatly from the teacher. We compute the difference between the teacher and the student and generate new data samples that maximize the divergence. This is done by perturbing data samples in the direction of the gradient of the difference between the student and the teacher. Augmenting the training set by adding this auxiliary improves the performance of KD significantly and leads to a closer match between the student and the teacher. Using this approach, when data samples come from a discrete domain, such as applications of natural language processing (NLP) and language understanding, is not trivial. However, we show how this technique can be used successfully in such applications. We evaluated the performance of our method on various tasks in computer vision and NLP domains and got promising results.
Dexterous Robotic Manipulation using Deep Reinforcement Learning and Knowledge Transfer for Complex Sparse Reward-based Tasks
Wang, Qiang, Sanchez, Francisco Roldan, McCarthy, Robert, Bulens, David Cordova, McGuinness, Kevin, O'Connor, Noel, Wรผthrich, Manuel, Widmaier, Felix, Bauer, Stefan, Redmond, Stephen J.
This paper describes a deep reinforcement learning (DRL) approach that won Phase 1 of the Real Robot Challenge (RRC) 2021, and then extends this method to a more difficult manipulation task. The RRC consisted of using a TriFinger robot to manipulate a cube along a specified positional trajectory, but with no requirement for the cube to have any specific orientation. We used a relatively simple reward function, a combination of goal-based sparse reward and distance reward, in conjunction with Hindsight Experience Replay (HER) to guide the learning of the DRL agent (Deep Deterministic Policy Gradient (DDPG)). Our approach allowed our agents to acquire dexterous robotic manipulation strategies in simulation. These strategies were then applied to the real robot and outperformed all other competition submissions, including those using more traditional robotic control techniques, in the final evaluation stage of the RRC. Here we extend this method, by modifying the task of Phase 1 of the RRC to require the robot to maintain the cube in a particular orientation, while the cube is moved along the required positional trajectory. The requirement to also orient the cube makes the agent unable to learn the task through blind exploration due to increased problem complexity. To circumvent this issue, we make novel use of a Knowledge Transfer (KT) technique that allows the strategies learned by the agent in the original task (which was agnostic to cube orientation) to be transferred to this task (where orientation matters). KT allowed the agent to learn and perform the extended task in the simulator, which improved the average positional deviation from 0.134 m to 0.02 m, and average orientation deviation from 142{\deg} to 76{\deg} during evaluation. This KT concept shows good generalisation properties and could be applied to any actor-critic learning algorithm.
Existing EdTech That You Didn't Know You Needed - Pikmykid
EdTech, or Educational Technology, refers to the use of technology to support and enhance teaching and learning. It can be a useful tool for educators by assisting to engage students, personalize learning, keep them safe and improve student outcomes. When it comes to the instructional methods and tools we use in our classrooms, there are several goals that educators may have in mind when selecting them. Therefore, knowing the types of technology available and the benefits of each is important. There are a variety of tools that have features promoting accessibility.
AI-powered "robot" lawyer won't argue in court after jail threats - CBS News
A "robot" lawyer powered by artificial intelligence was set to be the first of its kind to help a defendant fight a traffic ticket in court next month. But the experiment has been scrapped after "State Bar prosecutors" threatened the man behind the company that created the chatbot with prison time. Joshua Browder, CEO of DoNotPay, on Wednesday tweeted that his company "is postponing our court case and sticking to consumer rights." Bad news: after receiving threats from State Bar prosecutors, it seems likely they will put me in jail for 6 months if I follow through with bringing a robot lawyer into a physical courtroom. Browder also said he will not be sending the company's robot lawyer to court.
ChatGPT (barely) passed graduate business and law exams
There's plenty of concern that OpenAI's ChatGPT could help students cheat on tests, but just how well would the chatbot fare if you asked it to write a graduate-level exam? It would pass -- if only just. In a newly published study, University of Minnesota law professors had ChatGPT produce answers for graduate exams at four courses in their school. The AI passed all four, but with an average grade of C . In another recent paper, Wharton School of Business professor Christian Terwiesch found that ChatGPT passed a business management exam with a B to B- grade.
Data Analyst, Leveraged Loans at PitchBook Data - New York City, United States
At PitchBook, we are always looking forward. We continue to innovate, evolve and invest in ourselves to bring out the best in everyone. We're deeply collaborative and thrive on the excitement, energy and fun that reverberates throughout the company. Our extensive mentorship, education and training programs help us create a culture of curiosity that pushes us to always find new solutions and better ways of doing things. The combination of a rapidly evolving industry and our high ambitions means there's going to be some ambiguity along the way, but we excel when we challenge ourselves. We're willing to take risks, fail fast and do it all over again in the pursuit of excellence.
ChatGPT Isn't the Only Way to Use AI in Education
Soon after ChatGPT broke the internet, it sparked an all-too-familiar question for new technologies: What can it do for education? Many feared it would worsen plagiarism and further damage an already decaying humanism in the academy, while others lauded its potential to spark creativity and handle mundane educational tasks. Of course, ChatGPT is just one of many advances in artificial intelligence that have the capacity to alter pedagogical practices. The allure of AI-powered tools to help individuals maximize their understanding of academic subjects (or more effectively prepare for exams) by offering them the right content, in the right way, at the right time for them has spurred new investments from governments and private philanthropies. There is reason to be excited about such tools, especially if they can mitigate barriers to a higher quality or life--like reading proficiency disparities by race, which the NAACP has highlighted as a civil rights issue.
ChatGPT Is Coming for Classrooms. Don't Panic
When high school English teacher Kelly Gibson first encountered ChatGPT in December, the existential anxiety kicked in fast. While the internet delighted in the chatbot's superficially sophisticated answers to users' prompts, many educators were less amused. If anyone could ask ChatGPT to "write 300 words on what the green light symbolizes in The Great Gatsby," what would stop students from feeding their homework to the bot? "I thought, 'Oh my god, this is literally what I teach,'" Gibson says. But amid the panic, some enterprising teachers see ChatGPT as an opportunity to redesign what learning looks like--and what they invent could shape the future of the classroom. Gibson is one of them.
DCU to provide new machine learning module for undergrads
The machine learning module was compiled by researchers at the Insight centre for data analytics and the DCU computer science faculty. Students at Dublin City University (DCU) will soon be able to avail of a new module that provides an introduction to machine learning. The module will be provided to undergraduate computer science students. They will be able to learn the basics, as well as get an insight into how different industries and professionals use machine learning. Machine learning is an AI application that enables systems to self-programme by recognising patterns in large data sets.
Data mining of Clinical Databases - CDSS 1
This specialisation is for learners with experience in programming that are interested in expanding their skills in applying deep learning in Electronic Health Records and with a focus on how to translate their models into Clinical Decision Support Systems. The main areas that would explore are: Data mining of Clinical Databases: Ethics, MIMIC III database, International Classification of Disease System and definition of common clinical outcomes. Deep learning in Electronic Health Records: From descriptive analytics to predictive analytics Explainable deep learning models for healthcare applications: What it is and why it is needed Clinical Decision Support Systems: Generalisation, bias, 'fairness', clinical usefulness and privacy of artificial intelligence algorithms.