Government
On the Independence of Association Bias and Empirical Fairness in Language Models
Cabello, Laura, Jørgensen, Anna Katrine, Søgaard, Anders
The societal impact of pre-trained language models has prompted researchers to probe them for strong associations between protected attributes and value-loaded terms, from slur to prestigious job titles. Such work is said to probe models for bias or fairness-or such probes 'into representational biases' are said to be 'motivated by fairness'-suggesting an intimate connection between bias and fairness. We provide conceptual clarity by distinguishing between association biases (Caliskan et al., 2022) and empirical fairness (Shen et al., 2022) and show the two can be independent. Our main contribution, however, is showing why this should not come as a surprise. To this end, we first provide a thought experiment, showing how association bias and empirical fairness can be completely orthogonal. Next, we provide empirical evidence that there is no correlation between bias metrics and fairness metrics across the most widely used language models. Finally, we survey the sociological and psychological literature and show how this literature provides ample support for expecting these metrics to be uncorrelated.
Analyzing FOMC Minutes: Accuracy and Constraints of Language Models
Kim, Wonseong, Spörer, Jan Frederic, Handschuh, Siegfried
This research article analyzes the language used in the official statements released by the Federal Open Market Committee (FOMC) after its scheduled meetings to gain insights into the impact of FOMC official statements on financial markets and economic forecasting. The study reveals that the FOMC is careful to avoid expressing emotion in their sentences and follows a set of templates to cover economic situations. The analysis employs advanced language modeling techniques such as VADER and FinBERT, and a trial test with GPT-4. The results show that FinBERT outperforms other techniques in predicting negative sentiment accurately. However, the study also highlights the challenges and limitations of using current NLP techniques to analyze FOMC texts and suggests the potential for enhancing language models and exploring alternative approaches.
"HOT" ChatGPT: The promise of ChatGPT in detecting and discriminating hateful, offensive, and toxic comments on social media
Li, Lingyao, Fan, Lizhou, Atreja, Shubham, Hemphill, Libby
Harmful content is pervasive on social media, poisoning online communities and negatively impacting participation. A common approach to address this issue is to develop detection models that rely on human annotations. However, the tasks required to build such models expose annotators to harmful and offensive content and may require significant time and cost to complete. Generative AI models have the potential to understand and detect harmful content. To investigate this potential, we used ChatGPT and compared its performance with MTurker annotations for three frequently discussed concepts related to harmful content: Hateful, Offensive, and Toxic (HOT). We designed five prompts to interact with ChatGPT and conducted four experiments eliciting HOT classifications. Our results show that ChatGPT can achieve an accuracy of approximately 80% when compared to MTurker annotations. Specifically, the model displays a more consistent classification for non-HOT comments than HOT comments compared to human annotations. Our findings also suggest that ChatGPT classifications align with provided HOT definitions, but ChatGPT classifies "hateful" and "offensive" as subsets of "toxic." Moreover, the choice of prompts used to interact with ChatGPT impacts its performance. Based on these in-sights, our study provides several meaningful implications for employing ChatGPT to detect HOT content, particularly regarding the reliability and consistency of its performance, its understand-ing and reasoning of the HOT concept, and the impact of prompts on its performance. Overall, our study provides guidance about the potential of using generative AI models to moderate large volumes of user-generated content on social media.
US ignored own security warnings to ground Chinese drones
Kuala Lumpur, Malaysia and Taipei, Taiwan – A United States government agency grounded its drone fleet over concerns China could use the unmanned aircraft for spying despite internal warnings that a ban would in fact increase security risks, documents obtained by Al Jazeera reveal. The US Department of Interior (DOI) also disregarded warnings the ban could hamper efforts to fight wildfires, months before officials reported the restrictions were making fire-fighting more difficult and dangerous, the documents show. The DOI, which manages public lands and resources in the US, ordered the temporary grounding of drones made in China or containing Chinese parts in October 2019 amid deep suspicion of Chinese technology within the administration of former US President Donald Trump. Then-Secretary of the Interior David Bernhardt formalised the ban in January 2020 with an open-ended order grounding the DOI's entire 810-strong fleet of unmanned aircraft systems (UAVs) – whose uses include responding to natural disasters, geological surveys and wildlife population monitoring – until "cybersecurity, technology and domestic production concerns are adequately addressed". The order, which followed years of warnings that drones made by firms such as Shenzhen-based DJI could be secretly sending data to Beijing, included exceptions for emergency uses, such as fighting wildfires and search-and-rescue missions.
US jets intercept Russian Tu-95 bombers near Alaska; first encounter there since US drone taken down
Fox News Flash top headlines are here. Check out what's clicking on Foxnews.com. U.S. fighter jets intercepted Russian bomber aircraft near Alaska Monday, according to the Alaskan Region of North American Aerospace Defense Command (NORAD). NORAD made the announcement Wednesday in an official statement. "The Alaskan Region of North American Aerospace Defense Command (NORAD) detected, tracked, positively identified and intercepted two Russian aircraft entering and operating within the Alaska Air Defense Identification Zone (ADIZ) on April 17, 2023," the defense organization said.
US Federal Trade Commission leaders plan to pursue companies that misuse AI to violate civil rights
Check out what's clicking on Foxnews.com. Leaders of the U.S. Federal Trade Commission said on Tuesday the agency would pursue companies who misuse artificial intelligence to violate laws against discrimination or be deceptive. The sudden popularity of Microsoft-backed OpenAI's ChatGPT this year has prompted calls for regulation amid concerns around the world about the possible use of the innovation for wrongdoing even as companies are seeking ways to use it to enhance efficiency. In a congressional hearing, FTC Chair Lina Khan and Commissioners Rebecca Slaughter and Alvaro Bedoya were asked about concerns that recent innovation in artificial intelligence, which can be used to produce high quality deep fakes, could be used to make more effective scams or otherwise violate laws. FTC Chair Lina Khan testifies on Capitol Hill in Washington on April 21, 2021.
Regulating AI is going to be hard but big tech transparency is key
IT IS increasingly obvious that we are on the cusp of a revolution in artificial intelligence that will be no less profound than the arrival of the printing press or the internet, as we explore in this special issue. Nobody can say for sure exactly what this future will be, but optimists – including many of those working in the companies behind the technologies – foresee one in which AI will allow us to live our best lives (see "How this moment for AI will change society forever").
Ukraine receives US-made Patriot guided missile systems to help shield from Russian airstrikes
Fox News Flash top headlines are here. Check out what's clicking on Foxnews.com. Ukraine's defense minister said Wednesday his country has received the U.S-made Patriot surface-to-air guided missile systems it has long craved and which Kyiv hopes will help shield it from Russian airstrikes during the war. "Today, our beautiful Ukrainian sky becomes more secure because Patriot air defense systems have arrived in Ukraine," Defense Minister Oleksii Reznikov said in a tweet. Ukrainian officials have previously said the arrival of Patriot systems, which Washington agreed to send last October, would be a major boost and a milestone in the war against Moscow's full-scale invasion.
US Navy sails first drone boat through Strait of Hormuz between Iran, Oman
Fox News Flash top headlines are here. Check out what's clicking on Foxnews.com. The U.S. Navy sailed its first drone boat through the strategic Strait of Hormuz on Wednesday, a crucial waterway for global energy supplies where American sailors often faces tense encounters with Iranian forces. The trip by the L3 Harris Arabian Fox MAST-13, a 41-foot speedboat carrying sensors and cameras, drew the attention of Iran's Revolutionary Guard, but took place without incident, said Navy spokesman Cmdr. Two U.S. Coast Guard cutters, the USCGC Charles Moulthrope and USCGC John Scheuerman, accompanied the drone.
G7 digital chiefs to call for more research and governance of AI
The Group of Seven digital ministers will call for accelerated research into generative artificial intelligence systems, such as ChatGPT, at a meeting later this month, a draft communique showed Wednesday, as the rapid proliferation of such tools has raised concerns about their potential impact on society. During their two-day talks from April 29 in Takasaki, Gunma Prefecture, the ministers aim to formulate an action plan on AI governance, according to the draft. With the Japanese government also considering discussing generative AI at a G7 summit in May in the city of Hiroshima, the topic is also expected to be mentioned in a joint statement by the leaders. This could be due to a conflict with your ad-blocking or security software. Please add japantimes.co.jp and piano.io to your list of allowed sites.