Goto

Collaborating Authors

 Law



PAR: Political Actor Representation Learning with Social Context and Expert Knowledge

arXiv.org Artificial Intelligence

Modeling the ideological perspectives of political actors is an essential task in computational political science with applications in many downstream tasks. Existing approaches are generally limited to textual data and voting records, while they neglect the rich social context and valuable expert knowledge for holistic ideological analysis. In this paper, we propose \textbf{PAR}, a \textbf{P}olitical \textbf{A}ctor \textbf{R}epresentation learning framework that jointly leverages social context and expert knowledge. Specifically, we retrieve and extract factual statements about legislators to leverage social context information. We then construct a heterogeneous information network to incorporate social context and use relational graph neural networks to learn legislator representations. Finally, we train PAR with three objectives to align representation learning with expert knowledge, model ideological stance consistency, and simulate the echo chamber phenomenon. Extensive experiments demonstrate that PAR is better at augmenting political text understanding and successfully advances the state-of-the-art in political perspective detection and roll call vote prediction. Further analysis proves that PAR learns representations that reflect the political reality and provide new insights into political behavior.


AraLegal-BERT: A pretrained language model for Arabic Legal text

arXiv.org Artificial Intelligence

The effectiveness of the BERT model on multiple linguistic tasks has been well documented. On the other hand, its potentials for narrow and specific domains such as Legal, have not been fully explored. In this paper, we examine how BERT can be used in the Arabic legal domain and try customizing this language model for several downstream tasks using several different domain-relevant training and testing datasets to train BERT from scratch. We introduce the AraLegal-BERT, a bidirectional encoder Transformer-based model that have been thoroughly tested and carefully optimized with the goal to amplify the impact of NLP-driven solution concerning jurisprudence, legal documents, and legal practice. We fine-tuned AraLegal-BERT and evaluated it against three BERT variations for Arabic language in three natural languages understanding (NLU) tasks. The results show that the base version of AraLegal-BERT achieve better accuracy than the general and original BERT over the Legal text.


LAION-5B: An open large-scale dataset for training next generation image-text models

arXiv.org Artificial Intelligence

Groundbreaking language-vision architectures like CLIP and DALL-E proved the utility of training on large amounts of noisy image-text data, without relying on expensive accurate labels used in standard vision unimodal supervised learning. The resulting models showed capabilities of strong text-guided image generation and transfer to downstream tasks, while performing remarkably at zero-shot classification with noteworthy out-of-distribution robustness. Since then, large-scale language-vision models like ALIGN, BASIC, GLIDE, Flamingo and Imagen made further improvements. Studying the training and capabilities of such models requires datasets containing billions of image-text pairs. Until now, no datasets of this size have been made openly available for the broader research community. To address this problem and democratize research on large-scale multi-modal models, we present LAION-5B - a dataset consisting of 5.85 billion CLIP-filtered image-text pairs, of which 2.32B contain English language. We show successful replication and fine-tuning of foundational models like CLIP, GLIDE and Stable Diffusion using the dataset, and discuss further experiments enabled with an openly available dataset of this scale. Additionally we provide several nearest neighbor indices, an improved web-interface for dataset exploration and subset generation, and detection scores for watermark, NSFW, and toxic content detection. Announcement page https://laion.ai/laion-5b-a-new-era-of-open-large-scale-multi-modal-datasets/


Software Engineer (Machine Learning)

#artificialintelligence

Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or other applicable legally protected characteristics. You may view our Equal Employment Opportunity notice here. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. We may use your information to maintain the safety and security of Meta, its employees, and others as required or permitted by law.


The human factor in artificial intelligence

#artificialintelligence

Financial regulation is forever running to catch up with evolving technology. There are many examples of this: the Second Markets in Financial Instruments Directive (MiFID II) sought to make up ground on the increased electronification of markets since the introduction of MiFID I; policymakers in both the EU and the UK are at this very moment defining the regulatory perimeter around cryptoassets, more than a decade after the initial launch of bitcoin; and regulators first took action against runaway algorithms long before restrictions on algorithmic trading made it into regulatory rulebooks. Continuing this trend, on 11 October 2022, the Bank of England (BoE) and the UK Financial Conduct Authority (FCA) launched a joint discussion paper on how the UK regulators should approach the "safe and responsible" adoption of AI in financial services (FCA DP22/4 and BoE DP5/22) (the AI Discussion Paper), which is now open for responses. This follows the UK Government's Command Paper published in July 2022, announcing a "pro-innovation" approach to regulating AI (CP 728) across different sectors. One strong theme that comes out of the AI Discussion Paper is that, notwithstanding the potential benefits of AI in fostering innovation and reducing costs in financial services, the human factor is key to ensure that AI is governed and overseen responsibly and that potential negative impacts on clients and other stakeholders are mitigated appropriately. The fact that the regulators are consulting on bringing the oversight of AI expressly within the scope of the UK Senior Managers and Certifications Regime (SMCR) illustrates the importance of this human element, and that humans should continue to run the machines, rather than the other way around.


Is Neom a dystopian nightmare in the desert

Daily Mail - Science & tech

It bills itself as a futuristic megatropolis where residents will live in a 110-mile long skyscraper, a floating city and a high-tech mountain resort. But as we find out in this video, others fear it it is a dystopian nightmare in the making. Artificial intelligence will predict what residents need, they will by whisked around at hundreds of miles an hour by high-speed transport that hasn't even been invented yet. The Saudi Arabian city of Neom will have its own digital currency, and citizens will be constantly monitored by facial recognition cameras to manage the city's power and waste resources. And Horrifying new details are emerging about the fate of three Saudi tribesman who were this week sentenced to death for trying to object to the construction on their land.


Legal Case Document Summarization: Extractive and Abstractive Methods and their Evaluation

arXiv.org Artificial Intelligence

Summarization of legal case judgement documents is a challenging problem in Legal NLP. However, not much analyses exist on how different families of summarization models (e.g., extractive vs. abstractive) perform when applied to legal case documents. This question is particularly important since many recent transformer-based abstractive summarization models have restrictions on the number of input tokens, and legal documents are known to be very long. Also, it is an open question on how best to evaluate legal case document summarization systems. In this paper, we carry out extensive experiments with several extractive and abstractive summarization methods (both supervised and unsupervised) over three legal summarization datasets that we have developed. Our analyses, that includes evaluation by law practitioners, lead to several interesting insights on legal summarization in specific and long document summarization in general.


The State of Profanity Obfuscation in Natural Language Processing

arXiv.org Artificial Intelligence

Work on hate speech has made the consideration of rude and harmful examples in scientific publications inevitable. This raises various problems, such as whether or not to obscure profanities. While science must accurately disclose what it does, the unwarranted spread of hate speech is harmful to readers, and increases its internet frequency. While maintaining publications' professional appearance, obfuscating profanities makes it challenging to evaluate the content, especially for non-native speakers. Surveying 150 ACL papers, we discovered that obfuscation is usually employed for English but not other languages, and even so quite uneven. We discuss the problems with obfuscation and suggest a multilingual community resource called PrOf that has a Python module to standardize profanity obfuscation processes. We believe PrOf can help scientific publication policies to make hate speech work accessible and comparable, irrespective of language.


Enabling Classifiers to Make Judgements Explicitly Aligned with Human Values

arXiv.org Artificial Intelligence

Many NLP classification tasks, such as sexism/racism detection or toxicity detection, are based on human values. Yet, human values can vary under diverse cultural conditions. Therefore, we introduce a framework for value-aligned classification that performs prediction based on explicitly written human values in the command. Along with the task, we propose a practical approach that distills value-aligned knowledge from large-scale language models (LLMs) to construct value-aligned classifiers in two steps. First, we generate value-aligned training data from LLMs by prompt-based few-shot learning. Next, we fine-tune smaller classification models with the generated data for the task. Empirical results show that our VA-Models surpass multiple baselines by at least 15.56% on the F1-score, including few-shot learning with OPT-175B and existing text augmentation methods. We suggest that using classifiers with explicit human value input improves both inclusivity & explainability in AI.