Deep Learning
xAI Was About to Land a Major Government Contract. Then Grok Praised Hitler
In recent weeks, three of the leading American artificial intelligence firms have announced partnerships with the US government, promising the use of their services to federal workers for a paltry sum. Elon Musk's xAI was supposed to be part of the initiative, but a planned partnership fell apart after the Grok chatbot spouted antisemitic conspiracy theories on X in early July, WIRED has learned. The chaos surrounding the Grok deal reflects the Trump administration's current focus on speed and its disregard, at times, of preexisting norms surrounding government tech procurement. On May 15, fresh off a whirlwind trip to the Middle East with President Donald Trump, OpenAI CEO Sam Altman sent an email to the leadership team at the General Services Administration (GSA), the federal agency that manages government technology. He was inspired by Trump's desire to "go big," he said.
LIFT: Language-Interfaced Fine-Tuning for Non-Language Machine Learning Tasks
However, for non -language downstream tasks, a common practice is to employ task-specific designs for input, output layers, and loss functions. For instance, it is possible to fine-tune an LM into an MNIST classifier by replacing the word embedding layer with an image patch embedding layer, the word token output layer with a 10-way output layer, and the word prediction loss with a 10-way classification loss, respectively.