human rights violation
Should LLMs be WEIRD? Exploring WEIRDness and Human Rights in Large Language Models
Zhou, Ke, Constantinides, Marios, Quercia, Daniele
Large language models (LLMs) are often trained on data that reflect WEIRD values: Western, Educated, Industrialized, Rich, and Democratic. This raises concerns about cultural bias and fairness. Using responses to the World Values Survey, we evaluated five widely used LLMs: GPT-3.5, GPT-4, Llama-3, BLOOM, and Qwen. We measured how closely these responses aligned with the values of the WEIRD countries and whether they conflicted with human rights principles. To reflect global diversity, we compared the results with the Universal Declaration of Human Rights and three regional charters from Asia, the Middle East, and Africa. Models with lower alignment to WEIRD values, such as BLOOM and Qwen, produced more culturally varied responses but were 2% to 4% more likely to generate outputs that violated human rights, especially regarding gender and equality. For example, some models agreed with the statements ``a man who cannot father children is not a real man'' and ``a husband should always know where his wife is'', reflecting harmful gender norms. These findings suggest that as cultural representation in LLMs increases, so does the risk of reproducing discriminatory beliefs. Approaches such as Constitutional AI, which could embed human rights principles into model behavior, may only partly help resolve this tension.
- Europe > United Kingdom > England > Nottinghamshire > Nottingham (0.14)
- Europe > Austria > Vienna (0.14)
- Europe > Germany (0.05)
- (33 more...)
- Research Report > New Finding (1.00)
- Research Report > Experimental Study (1.00)
- Questionnaire & Opinion Survey (1.00)
Comparing LLM Text Annotation Skills: A Study on Human Rights Violations in Social Media Data
Nemkova, Poli Apollinaire, Ubani, Solomon, Albert, Mark V.
In the era of increasingly sophisticated natural language processing (NLP) systems, large language models (LLMs) have demonstrated remarkable potential for diverse applications, including tasks requiring nuanced textual understanding and contextual reasoning. This study investigates the capabilities of multiple state-of-the-art LLMs - GPT-3.5, GPT-4, LLAMA3, Mistral 7B, and Claude-2 - for zero-shot and few-shot annotation of a complex textual dataset comprising social media posts in Russian and Ukrainian. Specifically, the focus is on the binary classification task of identifying references to human rights violations within the dataset. To evaluate the effectiveness of these models, their annotations are compared against a gold standard set of human double-annotated labels across 1000 samples. The analysis includes assessing annotation performance under different prompting conditions, with prompts provided in both English and Russian. Additionally, the study explores the unique patterns of errors and disagreements exhibited by each model, offering insights into their strengths, limitations, and cross-linguistic adaptability. By juxtaposing LLM outputs with human annotations, this research contributes to understanding the reliability and applicability of LLMs for sensitive, domain-specific tasks in multilingual contexts. It also sheds light on how language models handle inherently subjective and context-dependent judgments, a critical consideration for their deployment in real-world scenarios.
- Europe > Ukraine (0.14)
- Asia > Russia (0.14)
- North America > United States > Texas (0.14)
- Europe > Russia (0.05)
- Law (0.53)
- Government (0.51)
- Health & Medicine (0.46)
- Information Technology (0.46)
Japan to disclose names of malicious AI businesses
The government plans to introduce a bill that would allow it to disclose the names of businesses using artificial intelligence to engage in malicious activities, such as crimes and human rights violations, officials said Monday. The planned legislation on dealing with the risks of AI and boosting Japan's international competitiveness on the technology is not expected to include penalties. The government aims to submit the bill to parliament next month. The bill states that the government can investigate malicious cases that cannot be handled by existing laws and regulations. Based on the results of probes, the government will be able to give direct guidance and advice to businesses and then publicly announce their names.
- Government (1.00)
- Law > Statutes (0.45)
EU research funds flow to Israel despite outrage over Gaza war
On October 7, as Israel began its latest war on Gaza following Hamas's incursion into southern Israel, the European Union's position was immediately clear. "Israel has a right to defend itself – today and in the days to come," European Commission President Ursula von der Leyen posted on X, alongside an image of her office's headquarters lit up with Israel's flag. "The European Union stands with Israel." Israel has since been placed on trial for genocide at the International Court of Justice (ICJ) at The Hague and its leaders – as well as a top Hamas commander – have been indicted by the International Criminal Court (ICC). Yet the EU continues to partner with Israeli institutions under its "Horizon" scheme, a programme that funds research and innovation.
- Asia > Middle East > Palestine > Gaza Strip > Gaza Governorate > Gaza (0.65)
- Europe > Netherlands > South Holland > The Hague (0.25)
- Asia > Middle East > Israel > Southern District (0.25)
- (2 more...)
- Law > International Law (1.00)
- Government > Military (1.00)
- Government > Regional Government > Europe Government (0.92)
- Government > Regional Government > Asia Government > Middle East Government (0.56)
Kenya's President Wades Into Meta Lawsuits
Can a Big Tech company be sued in Kenya for alleged abuses at an outsourcing company working on its behalf? That's the question at the heart of two lawsuits that are attempting to set a new precedent in Kenya, which is the prime destination for tech companies looking to farm out digital work to the African continent. The two-year legal battle stems from allegations of human rights violations at an outsourced Meta content moderation facility in Nairobi, where employees hired by a contractor were paid as little as 1.50 per hour to view traumatic content, such as videos of rapes, murders, and war crimes. The suits claim that despite the workers being contracted by an outsourcing company, called Sama, Meta essentially supervised and set the terms for the work, and designed and managed the software required for the task. Both companies deny wrongdoing and Meta has challenged the Kenyan courts' jurisdiction to hear the cases.
- Africa > Kenya > Nairobi City County > Nairobi (0.27)
- Asia > Philippines (0.05)
- Asia > India (0.05)
- Africa > Uganda (0.05)
- Law > Litigation (1.00)
- Government > Regional Government > Africa Government > Kenya Government (1.00)
Addis summit raises questions about AU's muted stance on Ethiopia rifts
From Thursday, African leaders will gather in the Ethiopian capital, Addis Ababa, home of the African Union (AU), for the continental body's annual summit. According to AU Commission Chairperson Moussa Faki Mahamat, regional integration and "maintaining momentum in addressing issues of peace and security" is high on the agenda. But in an ironic twist, the host of the summit has either initiated or been involved in multiple conflicts in the last three years. Ethiopia's two-year civil war with the state of Tigray may have ended in November 2022 after a Pretoria pact, but federal troops are currently upping drone strikes against rebels known as Fano militia in the state of Amhara, next door to Tigray. This week, the Ethiopian Human Rights Council said "at least 45 civilians" had been killed by federal troops in Amhara.
- North America > United States (0.49)
- Africa > Ethiopia > Addis Ababa > Addis Ababa (0.29)
- Africa > South Africa > Gauteng > Pretoria (0.26)
- (11 more...)
2024 candidate Suarez faceplants in radio interview: 'What is a Uyghur?'
Republican presidential candidate Francis Suarez appeared to admit during a Tuesday morning radio interview about national security that he does not know what a Uyghur is. The admission from Suarez came during an appearance on The Hugh Hewitt Show, where Hewitt asked Suarez, "Will you be talking about the Uyghurs in your campaign?" "The what," Suarez, the current mayor of Miami, responded. Republican presidential candidate and Mayor of Miami Francis Suarez delivers remarks at the Faith and Freedom Road to Majority conference on June 23, 2023, in Washington, DC. (Drew Angerer/Getty Images) "What's a Uyghur," Suarez inquired further. Moving on from the question due to Suarez's inability to identify what a Uyghur is, Hewitt told the mayor, "You've got to get smart on that."
- North America > United States > District of Columbia > Washington (0.25)
- North America > Canada > Ontario > Middlesex County > London (0.05)
- Asia > East Asia (0.05)
- (2 more...)
- Government > Voting & Elections (1.00)
- Government > Regional Government (1.00)
Detecting Human Rights Violations on Social Media during Russia-Ukraine War
Nemkova, Poli, Ubani, Solomon, Polat, Suleyman Olcay, Kim, Nayeon, Nielsen, Rodney D.
The present-day Russia-Ukraine military conflict has exposed the pivotal role of social media in enabling the transparent and unbridled sharing of information directly from the frontlines. In conflict zones where freedom of expression is constrained and information warfare is pervasive, social media has emerged as an indispensable lifeline. Anonymous social media platforms, as publicly available sources for disseminating war-related information, have the potential to serve as effective instruments for monitoring and documenting Human Rights Violations (HRV). Our research focuses on the analysis of data from Telegram, the leading social media platform for reading independent news in post-Soviet regions. We gathered a dataset of posts sampled from 95 public Telegram channels that cover politics and war news, which we have utilized to identify potential occurrences of HRV. Employing a mBERT-based text classifier, we have conducted an analysis to detect any mentions of HRV in the Telegram data. Our final approach yielded an $F_2$ score of 0.71 for HRV detection, representing an improvement of 0.38 over the multilingual BERT base model. We release two datasets that contains Telegram posts: (1) large corpus with over 2.3 millions posts and (2) annotated at the sentence-level dataset to indicate HRVs. The Telegram posts are in the context of the Russia-Ukraine war. We posit that our findings hold significant implications for NGOs, governments, and researchers by providing a means to detect and document possible human rights violations.
- Asia > Russia (1.00)
- Europe > Russia (0.94)
- North America > United States > Texas > Denton County > Denton (0.14)
- (8 more...)
- Law > Criminal Law (1.00)
- Law > Civil Rights & Constitutional Law (1.00)
- Government > Military (1.00)
- (3 more...)
- Information Technology > Communications > Social Media (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Neural Networks > Deep Learning (1.00)
- Information Technology > Artificial Intelligence > Natural Language > Large Language Model (0.70)
- Information Technology > Artificial Intelligence > Machine Learning > Performance Analysis (0.68)
Amazon Investors Demand Answers About Its Cloud's Human Rights Record
Amazon's marketing material boasts that more than 7,500 government agencies worldwide use its cloud computing service AWS. Some of its investors fear those contracts include projects that see the company's technology contribute to human rights violations. Today a collective of 50 organizations working on digital and human rights called the Athena Coalition filed a proposal asking Amazon shareholders to force the company to investigate possible human rights violations by government clients. Athena works with owners of stock in the company who have the right to file shareholder resolutions on corporate governance. The proposal will be put to a vote at Amazon's annual meeting next year.
- North America > United States (0.77)
- Asia > Middle East > Israel (0.17)
We need concrete protections from artificial intelligence threatening human rights
Events over the past few years have revealed several human rights violations associated with increasing advances in artificial intelligence (AI). Algorithms created to regulate speech online have censored speech ranging from religious content to sexual diversity. AI systems created to monitor illegal activities have been used to track and target human rights defenders. And algorithms have discriminated against Black people when they have been used to detect cancers or assess the flight risk of people accused of crimes. As researchers studying the intersection between AI and social justice, we've been examining solutions developed to tackle AI's inequities.