Goto

Collaborating Authors

 injunction


Interactive Analysis of LLMs using Meaningful Counterfactuals

Cheng, Furui, Zouhar, Vilém, Chan, Robin Shing Moon, Fürst, Daniel, Strobelt, Hendrik, El-Assady, Mennatallah

arXiv.org Artificial Intelligence

Counterfactual examples are useful for exploring the decision boundaries of machine learning models and determining feature attributions. How can we apply counterfactual-based methods to analyze and explain LLMs? We identify the following key challenges. First, the generated textual counterfactuals should be meaningful and readable to users and thus can be mentally compared to draw conclusions. Second, to make the solution scalable to long-form text, users should be equipped with tools to create batches of counterfactuals from perturbations at various granularity levels and interactively analyze the results. In this paper, we tackle the above challenges and contribute 1) a novel algorithm for generating batches of complete and meaningful textual counterfactuals by removing and replacing text segments in different granularities, and 2) LLM Analyzer, an interactive visualization tool to help users understand an LLM's behaviors by interactively inspecting and aggregating meaningful counterfactuals. We evaluate the proposed algorithm by the grammatical correctness of its generated counterfactuals using 1,000 samples from medical, legal, finance, education, and news datasets. In our experiments, 97.2% of the counterfactuals are grammatically correct. Through a use case, user studies, and feedback from experts, we demonstrate the usefulness and usability of the proposed interactive visualization tool.


The Morning After: Meta crams its AI chatbot into your Instagram DMs

Engadget

Instagram got a surprise visitor. Meta AI, the company's AI-powered chatbot that can answer questions, write poetry and generate images with a simple text prompt, is up in your DMs. Meta warned that Meta AI was coming and has spent the last few months adding the chatbot to products like Facebook Messenger and WhatsApp. We all knew Instagram would be next. "Our generative AI-powered experiences are under development in various phases, and we're testing a range of them publicly in a limited capacity," a Meta spokesperson told Engadget. For some of us at Engadget, the feature appeared in Instagram's Direct Messaging inbox.


On the Injunction of XAIxArt

Arora, Cheshta, Sarkar, Debarun

arXiv.org Artificial Intelligence

The position paper highlights the range of concerns that are engulfed in the injunction of explainable artificial intelligence in art (XAIxArt). Through a series of quick sub-questions, it points towards the ambiguities concerning 'explanation' and the postpositivist tradition of 'relevant explanation'. Rejecting both 'explanation' and 'relevant explanation', the paper takes a stance that XAIxArt is a symptom of insecurity of the anthropocentric notion of art and a nostalgic desire to return to outmoded notions of authorship and human agency. To justify this stance, the paper makes a distinction between an ornamentation model of explanation to a model of explanation as sense-making.


Court rules that Waymo can keep its robotaxi emergency protocols a secret

Engadget

The California Superior Court in Sacramento has ruled in favor of Waymo, allowing the company to keep specific details about its autonomous vehicle technology a secret. Waymo won the case against the California Department of Motor Vehicles, which it sued back in January to prevent the agency from disclosing what it considers trade secrets that could give its competitors an edge. While the Alphabet company filed a lawsuit against the DMV, it was an unidentified party that made a public records request for its driverless technology that started it all. The DMV gave Waymo the chance to redact information it deems to be trade secrets from its driverless deployment application before handing the copy over to the requester. However, the third party challenged the blacked out sections, and the DMV had advised Waymo to seek an injunction if it wants to prohibit the disclosure of the redacted materials. The information Waymo wants to keep secret includes how it plans to handle emergencies, such as how it analyzes collisions involving its vehicles, and how its technology decides when to hand over control to a human driver.


Judge denies L.A. police union's request to block vaccine mandate

Los Angeles Times

A judge on Wednesday denied a request by the Los Angeles police union that he block the city's COVID-19 vaccination mandate for police officers from taking effect. Having rejected the Police Protective League's petition for a temporary restraining order, California Superior Court Judge Mitchell L. Beckloff must still rule on a related request for a preliminary injunction, which would halt the mandate for officers while a lawsuit the union filed against the city over the rollout of the vaccine requirement goes forward. A court hearing on the injunction is scheduled for next month. The judge did not explain the reasoning for his decision in court records available online Thursday. Under the city's mandate, all city employees including police officers are required to be fully vaccinated by Dec. 18 unless they are granted a medical or religious exemption, and agree in the run-up to the deadline to submit to regular coronavirus testing if they are unvaccinated.


The Morning After: Vespa's first electric scooter has a release date

Engadget

On Monday Microsoft confirmed its (nearly) all-inclusive Xbox package, and we took the better part of an hour to appreciate some Cyberpunk 2077 footage. Also, Streets of Rage is coming back for more. Welcome to gaming as a service.Microsoft launches Xbox All Access with two-year console financing For $22 per month over two years, Microsoft will provide you with an Xbox One S console, access to over 100 games thanks to Xbox Game Pass and an Xbox Live Gold subscription. If you want an Xbox One X, then you'll shell out $35 per month. It's a financing program, rather than a subscription service, which means that you'll sign up for a two-year contract and then get to keep the console at the end of the period.


Champions League live streams to become harder to access as UEFA obtains blocking order

The Independent - Tech

UEFA has obtained a high court injunction that will make it harder for people in the UK to stream Champions League matches for free. Tne order allows it to tell the UK's biggest internet service providers (ISPs) to block any servers that are being used to distribute live footage of Champions League and Europa League matches. The orders can be made by UEFA – and acted upon by ISPs – as matches are being played, and the injunction covers all Champions League and Europa League games played between 13 February 2018 and 26 May 2018 – the day of the Champions League final. The I.F.O. is fuelled by eight electric engines, which is able to push the flying object to an estimated top speed of about 120mph. The giant human-like robot bears a striking resemblance to the military robots starring in the movie'Avatar' and is claimed as a world first by its creators from a South Korean robotic company Waseda University's saxophonist robot WAS-5, developed by professor Atsuo Takanishi and Kaptain Rock playing one string light saber guitar perform jam session A man looks at an exhibit entitled'Mimus' a giant industrial robot which has been reprogrammed to interact with humans during a photocall at the new Design Museum in South Kensington, London Electrification Guru Dr. Wolfgang Ziebart talks about the electric Jaguar I-PACE concept SUV before it was unveiled before the Los Angeles Auto Show in Los Angeles, California, U.S The Jaguar I-PACE Concept car is the start of a new era for Jaguar.


As Waymo v. Uber Kicks Off, Travis Kalanick Is in the Crosshairs

WIRED

Waymo, Alphabet's self-driving car company, filed its trade secrets theft lawsuit against Uber almost one year ago. If the case had immediately gone to trial, it might have looked a bit different. By now, though, tales of Uber's broken culture have been splashed across front webpages, new CEO Dara Khosrowshahi is a public contrition pro, and former CEO Travis Kalanick, the guy who allegedly drove the whole "win at all costs" ethos from the top, is, well, former. That makes Kalanick a very useful device for Waymo's legal team. On Monday, the first day of the blockbuster trial over autonomous vehicle lasers between Uber and Waymo, the Waymo lawyers made it clear: Kalanick will play the bad guy here.


Driverless cars: Tim Cook says Apple AI is applicable to more than just cars

#artificialintelligence

Autonomous cars have been a staple of science fiction for years, appearing in films like I, Robot, Demolition Man and Minority Report. Google is nearing the final stages of testing for its autonomous car programme, Tesla drivers can enjoy an'Autopilot' feature for hassle-free motorway driving, and Pittsburgh residents can hail an Uber that drives itself. But how do driverless cars work? When can we expect to try one out for ourselves? We answer all these questions, and more, below. The tech giant finally acknowledged the truth in rumours that it was building driverless technology in June, when Cook told Bloomberg that it was "a core technology that we view as very important". But he declined to give a steer on how the tech would manifest itself in Apple products. Yesterday he painted a clearer picture of its potential on a conference call following the company's quarterly results.


Uber Scores a Win, But Its Brawl With Waymo Ain't Over Yet

WIRED

In a significant victory for Uber amidst a year of suck, a California district court judge declined to halt the company's self-driving car program Monday morning. Judge William Alsup partly denied and partly granted a request for preliminary injunction from Google self-driving car spinoff Waymo, which alleges a former employee made off with its technology and used it to accelerate's Uber efforts. Uber does not have to stop self-driving testing, Alsup decreed. But the employee in question, engineer Anthony Levandowski, does have to stop all work on Uber's lidar technology until the lawsuit concludes. "We welcome the order to prohibit Uber's use of stolen documents containing trade secrets developed by Waymo through years of research, and to formally bar Mr. Levandowski from working on the technology," says a Waymo spokesperson.