Goto

Collaborating Authors

 Performance Analysis


Human-in-the-Loop Hate Speech Classification in a Multilingual Context

arXiv.org Artificial Intelligence

The shift of public debate to the digital sphere has been accompanied by a rise in online hate speech. While many promising approaches for hate speech classification have been proposed, studies often focus only on a single language, usually English, and do not address three key concerns: post-deployment performance, classifier maintenance and infrastructural limitations. In this paper, we introduce a new human-in-the-loop BERT-based hate speech classification pipeline and trace its development from initial data collection and annotation all the way to post-deployment. Our classifier, trained using data from our original corpus of over 422k examples, is specifically developed for the inherently multilingual setting of Switzerland and outperforms with its F1 score of 80.5 the currently best-performing BERT-based multilingual classifier by 5.8 F1 points in German and 3.6 F1 points in French. Our systematic evaluations over a 12-month period further highlight the vital importance of continuous, human-in-the-loop classifier maintenance to ensure robust hate speech classification post-deployment.


Learn to Explore: on Bootstrapping Interactive Data Exploration with Meta-learning

arXiv.org Artificial Intelligence

Interactive data exploration (IDE) is an effective way of comprehending big data, whose volume and complexity are beyond human abilities. The main goal of IDE is to discover user interest regions from a database through multi-rounds of user labelling. Existing IDEs adopt active-learning framework, where users iteratively discriminate or label the interestingness of selected tuples. The process of data exploration can be viewed as the process of training a classifier, which determines whether a database tuple is interesting to a user. An efficient exploration thus takes very few iterations of user labelling to reach the data region of interest. In this work, we consider the data exploration as the process of few-shot learning, where the classifier is learned with only a few training examples, or exploration iterations. To this end, we propose a learning-to-explore framework, based on meta-learning, which learns how to learn a classifier with automatically generated meta-tasks, so that the exploration process can be much shortened. Extensive experiments on real datasets show that our proposal outperforms existing explore-by-example solutions in terms of accuracy and efficiency.


Data Science & Machine Learning: Naive Bayes in Python - Views Coupon

#artificialintelligence

Why should you take this course? Naive Bayes is one of the fundamental algorithms in machine learning, data science, and artificial intelligence. No practitioner is complete without mastering it. This course is designed to be appropriate for all levels of students, whether you are beginner, intermediate, or advanced. You'll learn both the intuition for how Naive Bayes works and how to apply it effectively while accounting for the unique characteristics of the Naive Bayes algorithm.


Domain-specific transfer learning in the automated scoring of tumor-stroma ratio from histopathological images of colorectal cancer

arXiv.org Artificial Intelligence

Tumor-stroma ratio (TSR) is a prognostic factor for many types of solid tumors. In this study, we propose a method for automated estimation of TSR from histopathological images of colorectal cancer. The method is based on convolutional neural networks which were trained to classify colorectal cancer tissue in hematoxylin-eosin stained samples into three classes: stroma, tumor and other. The models were trained using a data set that consists of 1343 whole slide images. Three different training setups were applied with a transfer learning approach using domain-specific data i.e. an external colorectal cancer histopathological data set. The three most accurate models were chosen as a classifier, TSR values were predicted and the results were compared to a visual TSR estimation made by a pathologist. The results suggest that classification accuracy does not improve when domain-specific data are used in the pre-training of the convolutional neural network models in the task at hand. Classification accuracy for stroma, tumor and other reached 96.1$\%$ on an independent test set. Among the three classes the best model gained the highest accuracy (99.3$\%$) for class tumor. When TSR was predicted with the best model, the correlation between the predicted values and values estimated by an experienced pathologist was 0.57. Further research is needed to study associations between computationally predicted TSR values and other clinicopathological factors of colorectal cancer and the overall survival of the patients.


How to Find False Negatives in Facial Recognition with Neo4j - Sefik Ilkin Serengil

#artificialintelligence

Current cutting-edge facial recognition models offer human-level accuracy. Still, we can improve facial recognition model accuracies if we represent classifications in a graph. In this post, we are going to find false negative classifications of facial recognition models with Neo4j graph database. We have just focused on detecting false positives in facial recognition with Neo4j. False positives are mis-classifications verifying different persons as same person.


"Real Attackers Don't Compute Gradients": Bridging the Gap Between Adversarial ML Research and Practice

arXiv.org Artificial Intelligence

According to the few recorded accounts Next we turn our attention to the research domain and of security failures "in the wild," ML systems can be broken take a snapshot of the current landscape of adversarial ML by naรฏve attackers that are not systematically exploiting the as portrayed in scientific papers ( IV). After surveying the vulnerabilities of ML, but rather are developing attacks by proceedings of the "Top-4" security conferences from 2019 guessing--either indiscriminately or by some coarse heuristic to 2021, we systematically analyze all 88 papers that consider [6], [7]. Red-team exercises on ML systems often take attacks against ML or corresponding defenses. Of these papers, advantage of security gaps that are agnostic to the existence 89% only evaluate algorithms based on neural networks, 63% of an ML model, and subsequent defensive recommendations focus on computer vision, and 80% perform their experiments are likewise more broad than, e.g., adversarial training [8], on "benchmarks". We discover several inconsistencies in the [9]. Additionally, the ML models deployed in productiongrade terminology adopted in reputable prior work. We also identify ML systems are often not directly observable (and are several positive trends, such as an increasing amount of papers sometimes even unreachable) by most attackers [10].


Functional Integrative Bayesian Analysis of High-dimensional Multiplatform Genomic Data

arXiv.org Machine Learning

Rapid advancements in collection, processing, and dissemination of multi-platform molecular and genomics (multi-omics, in short) data has resulted in enormous opportunities to aggregate such data in order to understand, prevent, and treat diseases. This has catalyzed development of integrative methods that can collectively mine multiple types and scales of multi-omics data, in order to provide a more holistic view of human disease evolution and progression (Subramanian et al. 2020). Specifically, in the context of cancer, a disease driven predominantly by agglomerations of several molecular changes (Sun et al. 2021), the importance of synthesizing information from multi-platform omics and clinical sources to understand the cellular basis of the disease is even further underscored. Cellular oncological mechanisms, triggered at different molecular levels of the DNA RNA Protein path, can confer profound phenotypic advantages/disadvantages. While significant improvements have been made in multi-omics data integration methods to unveil such mechanisms, focused on both prognosis (Duan et al. 2021) and treatment (Finotello et al. 2020), the precise functions governing them need detailed and data-driven de-novo evaluations. Our work, in the same vein, aims at two different but inter-related scientific axes: (i) selection of biomarkers associated with cancer prognosis and clinical outcomes, and (ii) learning the mechanism of these biomarkers' effects upon such outcomes via integrating upstream molecular information - we provide some additional scientific context below. Classes of Integrative Omics Models First, we briefly discuss existing integrative omics approaches in order to contextualize the need for our framework. Broadly, most of the existing integrative statistical methods can be classified into two categories - horizontal (meta-analysis type) and vertical (multi-omics) integration procedures (Tseng et al. 2015).


Finding Representative Group Fairness Metrics Using Correlation Estimations

arXiv.org Artificial Intelligence

It is of critical importance to be aware of the historical discrimination embedded in the data and to consider a fairness measure to reduce bias throughout the predictive modeling pipeline. Given various notions of fairness defined in the literature, investigating the correlation and interaction among metrics is vital for addressing unfairness. Practitioners and data scientists should be able to comprehend each metric and examine their impact on one another given the context, use case, and regulations. Exploring the combinatorial space of different metrics for such examination is burdensome. To alleviate the burden of selecting fairness notions for consideration, we propose a framework that estimates the correlation among fairness notions. Our framework consequently identifies a set of diverse and semantically distinct metrics as representative for a given context. We propose a Monte-Carlo sampling technique for computing the correlations between fairness metrics by indirect and efficient perturbation in the model space. Using the estimated correlations, we then find a subset of representative metrics. The paper proposes a generic method that can be generalized to any arbitrary set of fairness metrics. We showcase the validity of the proposal using comprehensive experiments on real-world benchmark datasets.


Data-Driven Revision of Conditional Norms in Multi-Agent Systems

Journal of Artificial Intelligence Research

In multi-agent systems, norm enforcement is a mechanism for steering the behavior of individual agents in order to achieve desired system-level objectives. Due to the dynamics of multi-agent systems, however, it is hard to design norms that guarantee the achievement of the objectives in every operating context. Also, these objectives may change over time, thereby making previously defined norms ineffective. In this paper, we investigate the use of system execution data to automatically synthesise and revise conditional prohibitions with deadlines, a type of norms aimed at prohibiting agents from exhibiting certain patterns of behaviors. We propose DDNR (Data-Driven Norm Revision), a data-driven approach to norm revision that synthesises revised norms with respect to a data set of traces describing the behavior of the agents in the system. We evaluate DDNR using a state-of-the-art, off-the-shelf urban traffic simulator. The results show that DDNR synthesises revised norms that are significantly more accurate than the original norms in distinguishing adequate and inadequate behaviors for the achievement of the system-level objectives.


Twitter Artificial Intelligence

#artificialintelligence

How does Twitter use artificial intelligence and machine learning? Twitter uses large-scale machine learning and AI for sentiment analysis, bot analysis and detection of fake accounts, image classification and more. From Amazon to Instagram, Sephora, Microsoft, and Twitter, AI will shape the future of speech in America and beyond. The big question is not if they use it, but how it is being used, and what impact will this have on consumer privacy in the future. For the past fifteen years, I have been a national commentator on the politics of big tech and social media platforms. Social Media content decisions have become highly political, and artificial intelligence has proliferated this process at scale. But somewhere along the way, the public was left in the dark on just how large of a role machine learning plays in large-scale content operations in Silicon Valley. While the national conversation on free speech focuses on high-profile executives of tech companies and how content ...