Biden admin warns AI in schools may exhibit racial bias, anti-trans discrimination and trigger investigations

Many people in Nashville say they don't trust artificial intelligence chatbots to give them unbiased information amid the backlash Google faces over its Gemini program. On Tuesday, the Department of Education's Office for Civil Rights (OCR) released presidentially-mandated guidance that lays out how schools' use of artificial intelligence (AI) can be discriminatory toward minority and transgender students, "likely" opening them up to federal investigations. President Biden signed Executive Order 14110 last year mandating that the Education Department develop resources, policies and guidance regarding AI in schools to help ensure responsible and non-discriminatory use, "including the impact AI systems have on vulnerable and underserved communities." "The growing use of AI in schools, including for instructional and school safety purposes, and AI's ability to operate on a mass scale can create or contribute to discrimination," the Education Department's guidance states. "This resource provides information regarding federal civil rights laws in OCR's jurisdiction and includes examples of types of incidents that could, depending on the facts and circumstances, present OCR with sufficient reason to open an investigation."