Operations
NTSB will investigate why Waymo's robotaxis are illegally passing school buses
The safety probe comes after Waymo did a voluntary software recall late last year addressing the same issue. Waymo has caught the attention of the National Transportation Safety Board as the federal agency launched an official investigation into the company for its robotaxis improperly passing school buses in Austin, Texas. The NTSB said on X that it would examine the interaction between Waymo vehicles and school buses stopped for loading and unloading students. The latest federal probe stems from a preliminary evaluation by the National Highway Traffic Safety Administration that looked into how Waymo reacts to stopped school buses in the Texas city. That report led to Waymo's voluntary software recall in December.
- Transportation > Ground > Road (1.00)
- Government > Regional Government > North America Government > United States Government (1.00)
- Education > Operations > School Transportation (1.00)
- Information Technology > Artificial Intelligence > Robots > Autonomous Vehicles (0.78)
- Information Technology > Communications > Mobile (0.58)
Predicting First Year Dropout from Pre Enrolment Motivation Statements Using Text Mining
Soppe, K. F. B., Bagheri, A., Nadi, S., Klugkist, I. G., Wubbels, T., Meij, L. D. N. V. Wijngaards-De
Preventing student dropout is a major challenge in higher education and it is difficult to predict prior to enrolment which students are likely to drop out and which students are likely to succeed. High School GPA is a strong predictor of dropout, but much variance in dropout remains to be explained. This study focused on predicting university dropout by using text mining techniques with the aim of exhuming information contained in motivation statements written by students. By combining text data with classic predictors of dropout in the form of student characteristics, we attempt to enhance the available set of predictive student characteristics. Our dataset consisted of 7,060 motivation statements of students enrolling in a non-selective bachelor at a Dutch university in 2014 and 2015. Support Vector Machines were trained on 75 percent of the data and several models were estimated on the test data. We used various combinations of student characteristics and text, such as TFiDF, topic modelling, LIWC dictionary. Results showed that, although the combination of text and student characteristics did not improve the prediction of dropout, text analysis alone predicted dropout similarly well as a set of student characteristics. Suggestions for future research are provided.
- Europe > Sweden (0.04)
- Europe > Slovenia > Central Slovenia > Municipality of Ljubljana > Ljubljana (0.04)
- Europe > Netherlands > North Holland > Amsterdam (0.04)
- (2 more...)
- Research Report > New Finding (1.00)
- Research Report > Experimental Study (0.68)
- Education > Educational Setting > K-12 Education > Secondary School (0.49)
- Education > Operations > Student Enrollment (0.48)
- Education > Educational Setting > Online (0.47)
- Education > Educational Setting > Higher Education (0.35)
Does Liking Yellow Imply Driving a School Bus? Semantic Leakage in Language Models
Gonen, Hila, Blevins, Terra, Liu, Alisa, Zettlemoyer, Luke, Smith, Noah A.
Despite their wide adoption, the biases and unintended behaviors of language models remain poorly understood. In this paper, we identify and characterize a phenomenon never discussed before, which we call semantic leakage, where models leak irrelevant information from the prompt into the generation in unexpected ways. We propose an evaluation setting to detect semantic leakage both by humans and automatically, curate a diverse test suite for diagnosing this behavior, and measure significant semantic leakage in 13 flagship models. We also show that models exhibit semantic leakage in languages besides English and across different settings and generation scenarios. This discovery highlights yet another type of bias in language models that affects their generation patterns and behavior.
- Leisure & Entertainment (0.46)
- Education > Operations > School Transportation (0.41)
- Information Technology > Artificial Intelligence > Natural Language > Large Language Model (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Neural Networks > Deep Learning (1.00)
- Information Technology > Artificial Intelligence > Natural Language > Chatbot (0.99)
- Information Technology > Artificial Intelligence > Natural Language > Text Processing (0.93)
Reducing the Filtering Effect in Public School Admissions: A Bias-aware Analysis for Targeted Interventions
Faenza, Yuri, Gupta, Swati, Vuorinen, Aapeli, Zhang, Xuan
Problem definition: Traditionally, New York City's top 8 public schools have selected candidates solely based on their scores in the Specialized High School Admissions Test (SHSAT). These scores are known to be impacted by socioeconomic status of students and test preparation received in middle schools, leading to a massive filtering effect in the education pipeline. The classical mechanisms for assigning students to schools do not naturally address problems like school segregation and class diversity, which have worsened over the years. The scientific community, including policymakers, have reacted by incorporating group-specific quotas and proportionality constraints, with mixed results. The problem of finding effective and fair methods for broadening access to top-notch education is still unsolved. Methodology/results: We take an operations approach to the problem different from most established literature, with the goal of increasing opportunities for students with high economic needs. Using data from the Department of Education (DOE) in New York City, we show that there is a shift in the distribution of scores obtained by students that the DOE classifies as "disadvantaged" (following criteria mostly based on economic factors). We model this shift as a "bias" that results from an underestimation of the true potential of disadvantaged students. We analyze the impact this bias has on an assortative matching market. We show that centrally planned interventions can significantly reduce the impact of bias through scholarships or training, when they target the segment of disadvantaged students with average performance.
- North America > United States > Texas (0.04)
- North America > United States > New York > New York County > New York City (0.04)
- North America > United States > Michigan (0.04)
- (4 more...)
- Education > Educational Setting > K-12 Education (1.00)
- Education > Operations > Student Enrollment (0.72)
Integrating AI Tutors in a Programming Course
Ma, Iris, Martins, Alberto Krone, Lopes, Cristina Videira
RAGMan is an LLM-powered tutoring system that can support a variety of course-specific and homework-specific AI tutors. RAGMan leverages Retrieval Augmented Generation (RAG), as well as strict instructions, to ensure the alignment of the AI tutors' responses. By using RAGMan's AI tutors, students receive assistance with their specific homework assignments without directly obtaining solutions, while also having the ability to ask general programming-related questions. RAGMan was deployed as an optional resource in an introductory programming course with an enrollment of 455 students. It was configured as a set of five homework-specific AI tutors. This paper describes the interactions the students had with the AI tutors, the students' feedback, and a comparative grade analysis. Overall, about half of the students engaged with the AI tutors, and the vast majority of the interactions were legitimate homework questions. When students posed questions within the intended scope, the AI tutors delivered accurate responses 98% of the time. Within the students used AI tutors, 78% reported that the tutors helped their learning. Beyond AI tutors' ability to provide valuable suggestions, students reported appreciating them for fostering a safe learning environment free from judgment.
- North America > United States > California > Orange County > Irvine (0.14)
- North America > United States > New York > New York County > New York City (0.05)
- Oceania > Australia > Victoria > Melbourne (0.04)
- (5 more...)
- Research Report > Experimental Study (0.94)
- Questionnaire & Opinion Survey (0.94)
- Research Report > New Finding (0.93)
- Instructional Material (0.88)
- Education > Curriculum (0.50)
- Education > Educational Setting (0.47)
- Education > Operations > Student Enrollment (0.34)
- Education > Educational Technology > Educational Software > Computer Based Training (0.34)
Large Language Model as an Assignment Evaluator: Insights, Feedback, and Challenges in a 1000+ Student Course
Chiang, Cheng-Han, Chen, Wei-Chih, Kuan, Chun-Yi, Yang, Chienchou, Lee, Hung-yi
Using large language models (LLMs) for automatic evaluation has become an important evaluation method in NLP research. However, it is unclear whether these LLM-based evaluators can be applied in real-world classrooms to assess student assignments. This empirical report shares how we use GPT-4 as an automatic assignment evaluator in a university course with 1,028 students. Based on student responses, we find that LLM-based assignment evaluators are generally acceptable to students when students have free access to these LLM-based evaluators. However, students also noted that the LLM sometimes fails to adhere to the evaluation instructions. Additionally, we observe that students can easily manipulate the LLM-based evaluator to output specific strings, allowing them to achieve high scores without meeting the assignment rubric. Based on student feedback and our experience, we provide several recommendations for integrating LLM-based evaluators into future classrooms.
- Asia > Singapore (0.04)
- North America > Canada > Ontario > Toronto (0.04)
- Asia > Taiwan (0.04)
- (5 more...)
- Research Report (1.00)
- Instructional Material > Course Syllabus & Notes (1.00)
- Education > Operations > Student Enrollment (0.70)
- Education > Assessment & Standards > Student Performance (0.67)
- Education > Educational Setting > Higher Education (0.48)
More than 1,000 students pledge not to work at Google and Amazon due to Project Nimbus
No Tech for Apartheid (NOTA), a coalition of tech workers demanding big tech companies to drop their contracts with the Israeli government, is close to reaching its goal for a campaign asking students not to work with Google and Amazon. As Wired reports, more than 1,100 people who identified themselves as STEM students and young workers have taken the pledge to refuse jobs from the companies "for powering Israel's Apartheid system and genocide against Palestinians." Based on its website, NOTA's goal is to gather 1,200 signatures for the campaign. "As young people and students in STEM and beyond, we refuse to have any part in these horrific abuses. We're joining the #NoTechForApartheid campaign to demand Amazon and Google immediately end Project Nimbus," part of the pledge reads.
- Asia > Middle East > Israel (0.66)
- North America > United States > California > San Francisco County > San Francisco (0.10)
- North America > United States > New York (0.07)
- Information Technology > Services (0.40)
- Education > Operations > Student Enrollment (0.40)
- Government > Regional Government > Asia Government > Middle East Government > Israel Government (0.30)
On Perception of Prevalence of Cheating and Usage of Generative AI
This report investigates the perceptions of teaching staff on the prevalence of student cheating and the impact of Generative AI on academic integrity. Data was collected via an anonymous survey of teachers at the Department of Information Technology at Uppsala University and analyzed alongside institutional statistics on cheating investigations from 2004 to 2023. The results indicate that while teachers generally do not view cheating as highly prevalent, there is a strong belief that its incidence is increasing, potentially due to the accessibility of Generative AI. Most teachers do not equate AI usage with cheating but acknowledge its widespread use among students. Furthermore, teachers' perceptions align with objective data on cheating trends, highlighting their awareness of the evolving landscape of academic dishonesty.
- Research Report (1.00)
- Overview (1.00)
Student uses AI to decipher word in ancient scroll from Herculaneum
The Greek word for "purple" has been extracted from a Herculaneum scroll Almost 2000 years after they were buried by the volcanic eruption of Mount Vesuvius in AD 79, scrolls from a library in the ancient Roman town of Herculaneum have begun to reveal their secrets. The tightly wrapped papyrus scrolls were charred in the disaster, which also destroyed the nearby town of Pompeii. But by studying 3D X-ray scans of the scrolls, researchers have deciphered a word on one of them: "porphyras", meaning "purple". The breakthrough came from Luke Farritor, a 21-year-old computer science student at the University of Nebraska-Lincoln. His success involved training an AI to identify nearly invisible ink-like patterns in the 3D scans. "Seeing Luke's first word was a shock," says Michael McOsker at the University College London in the UK, who was not involved in the discovery.
- North America > United States > Nebraska > Lancaster County > Lincoln (0.26)
- Europe > United Kingdom (0.26)
- North America > United States > Kentucky (0.06)
- Europe > Germany (0.06)
- Education > Operations > Student Enrollment (0.40)
- Education > Educational Setting > Higher Education (0.38)
Explainable Disparity Compensation for Efficient Fair Ranking
Ranking functions that are used in decision systems often produce disparate results for different populations because of bias in the underlying data. Addressing, and compensating for, these disparate outcomes is a critical problem for fair decision-making. Recent compensatory measures have mostly focused on opaque transformations of the ranking functions to satisfy fairness guarantees or on the use of quotas or set-asides to guarantee a minimum number of positive outcomes to members of underrepresented groups. In this paper we propose easily explainable data-driven compensatory measures for ranking functions. Our measures rely on the generation of bonus points given to members of underrepresented groups to address disparity in the ranking function. The bonus points can be set in advance, and can be combined, allowing for considering the intersections of representations and giving better transparency to stakeholders. We propose efficient sampling-based algorithms to calculate the number of bonus points to minimize disparity. We validate our algorithms using real-world school admissions and recidivism datasets, and compare our results with that of existing fair ranking algorithms.
- North America > United States > New Jersey > Middlesex County > Piscataway (0.04)
- North America > United States > Massachusetts > Middlesex County > Cambridge (0.04)
- North America > United States > Illinois > Cook County > Chicago (0.04)
- (4 more...)
- Law (0.93)
- Education > Educational Setting (0.47)
- Education > Operations > Student Enrollment (0.35)