Goto

Collaborating Authors

 Accuracy


Confusion Matrix

#artificialintelligence

We have all studied about the matrices and vectors in our Schools and Colleges lectures. Well matrix is a kind of N dimensional array that represents rows and columns and has its various types used across in field of Statistics and Science. But here we are not talking about the matrices that we learnt in our math lectures. In the field of Artificial Intelligence and Machine Learning, there is another concept and completely different matrix we use in our algorithm. Confusion Matrix, as the name suggests it has confused everyone who tried to dealt with it in their first attempt.


Saints' Michael Burton active for game against Lions after false positive COVID-19 test

FOX News

New Orleans Saints' fullback Michael Burton will be active for Sunday's game against the Detroit Lions just one day after receiving a false positive COVID-19 test result. Burton tested positive on Saturday night signaling trouble for the league already dealing with an outbreak and several other isolated cases among teams but a re-test on Sunday morning turned back a negative test result, The Athletic reported. Burton and other Saints players also underwent rapid testing which all came back negative giving them a green light to carry on with the Lions game as scheduled. The NFL has been forced to postpone two games and adjust team schedules after the Tennessee Titans had around 20 people - 10 players and 10 personnel - test positive this past week. The Titans-Pittsburgh Steelers game, originally scheduled for Sunday, was postponed until Oct. 25 -- during Tennessee's bye.


AI can detect COVID-19 in the lungs like a virtual physician, new study shows

#artificialintelligence

The new UCF co-developed algorithm can accurately identify COVID-19 cases, as well as distinguish them from influenza. ORLANDO, Sept. 30, 2020 - A University of Central Florida researcher is part of a new study showing that artificial intelligence can be nearly as accurate as a physician in diagnosing COVID-19 in the lungs. The study, recently published in Nature Communications, shows the new technique can also overcome some of the challenges of current testing. Researchers demonstrated that an AI algorithm could be trained to classify COVID-19 pneumonia in computed tomography (CT) scans with up to 90 percent accuracy, as well as correctly identify positive cases 84 percent of the time and negative cases 93 percent of the time. CT scans offer a deeper insight into COVID-19 diagnosis and progression as compared to the often-used reverse transcription-polymerase chain reaction, or RT-PCR, tests.


Fairness in Machine Learning: A Survey

arXiv.org Machine Learning

As Machine Learning technologies become increasingly used in contexts that affect citizens, companies as well as researchers need to be confident that their application of these methods will not have unexpected social implications, such as bias towards gender, ethnicity, and/or people with disabilities. There is significant literature on approaches to mitigate bias and promote fairness, yet the area is complex and hard to penetrate for newcomers to the domain. This article seeks to provide an overview of the different schools of thought and approaches to mitigating (social) biases and increase fairness in the Machine Learning literature. It organises approaches into the widely accepted framework of pre-processing, in-processing, and post-processing methods, subcategorizing into a further 11 method areas. Although much of the literature emphasizes binary classification, a discussion of fairness in regression, recommender systems, unsupervised learning, and natural language processing is also provided along with a selection of currently available open source libraries. The article concludes by summarising open challenges articulated as four dilemmas for fairness research.


Self-supervised Learning from a Multi-view Perspective

arXiv.org Machine Learning

As a subset of unsupervised representation learning, self-supervised representation learning adopts self-defined signals as supervision and uses the learned representation for downstream tasks, such as object detection and image captioning. Many proposed approaches for self-supervised learning follow naturally a multi-view perspective, where the input (e.g., original images) and the self-supervised signals (e.g., augmented images) can be seen as two redundant views of the data. Building from this multi-view perspective, this paper provides an information-theoretical framework to better understand the properties that encourage successful self-supervised learning. Specifically, we demonstrate that self-supervised learned representations can extract task-relevant information and discard task-irrelevant information. Our theoretical framework paves the way to a larger space of self-supervised learning objective design. In particular, we propose a composite objective that bridges the gap between prior contrastive and predictive learning objectives, and introduce an additional objective term to discard task-irrelevant information. To verify our analysis, we conduct controlled experiments to evaluate the impact of the composite objectives. We also explore our framework's empirical generalization beyond the multi-view perspective, where the cross-view redundancy may not be clearly observed.


Convolutional Neural Networks for Automated PET/CT Detection of Diseased Lymph Node Burden in Patients with Lymphoma

#artificialintelligence

To automatically detect lymph nodes involved in lymphoma on fluorine 18 (18F) fluorodeoxyglucose (FDG) PET/CT images using convolutional neural networks (CNNs). In this retrospective study, baseline disease of 90 patients with lymphoma was segmented on 18F-FDG PET/CT images (acquired between 2005 and 2011) by a nuclear medicine physician. An ensemble of three-dimensional patch-based, multiresolution pathway CNNs was trained using fivefold cross-validation. Performance was assessed using the true-positive rate (TPR) and number of false-positive (FP) findings. CNN performance was compared with agreement between physicians by comparing the annotations of a second nuclear medicine physician to the first reader in 20 of the patients.


Coronavirus testing: What is a false positive?

BBC News

There has been a lot of talk on social media about "false positive" test results after several commentators suggested they might be seriously skewing the coronavirus figures - but that is based on a misunderstanding of the impact of false positives. Talk Radio host Julia Hartley-Brewer has claimed that "nine out of 10 of the positive cases of Covid we are finding in the community when we do random testing, when anyone just puts themselves forward, will be wrong. They will not be people who have got coronavirus." Could it be true that 90% of positive results from tests in the community - that means tests not carried out in hospitals - are false? The answer is "no" - there is no way that so-called false positives have had such an impact on the figures.


Informative Outlier Matters: Robustifying Out-of-distribution Detection Using Outlier Mining

arXiv.org Machine Learning

Detecting out-of-distribution (OOD) inputs is critical for safely deploying deep learning models in an open-world setting. However, existing OOD detection solutions can be brittle in the open world, facing various types of adversarial OOD inputs. While methods leveraging auxiliary OOD data have emerged, our analysis reveals a key insight that the majority of auxiliary OOD examples may not meaningfully improve the decision boundary of the OOD detector. In this paper, we provide a theoretically motivated method, Adversarial Training with informative Outlier Mining (ATOM), which improves the robustness of OOD detection. We show that, by mining informative auxiliary OOD data, one can significantly improve OOD detection performance, and somewhat surprisingly, generalize to unseen adversarial attacks. ATOM achieves state-of-the-art performance under a broad family of natural and perturbed OOD evaluation tasks. For example, on the CIFAR-10 in-distribution dataset, ATOM reduces the FPR95 by up to 57.99% under adversarial OOD inputs, surpassing the previous best baseline by a large margin.


Consistent Estimators for Learning to Defer to an Expert

arXiv.org Machine Learning

Learning algorithms are often used in conjunction with expert decision makers in practical scenarios, however this fact is largely ignored when designing these algorithms. In this paper we explore how to learn predictors that can either predict or choose to defer the decision to a downstream expert. Given only samples of the expert's decisions, we give a procedure based on learning a classifier and a rejector and analyze it theoretically. Our approach is based on a novel reduction to cost sensitive learning where we give a consistent surrogate loss for cost sensitive learning that generalizes the cross entropy loss. We show the effectiveness of our approach on a variety of experimental tasks.


Revisiting Membership Inference Under Realistic Assumptions

arXiv.org Machine Learning

We study membership inference in settings where some of the assumptions typically used in previous research are relaxed. First, we consider skewed priors, to cover cases such as when only a small fraction of the candidate pool targeted by the adversary are actually members and develop a PPV-based metric suitable for this setting. This setting is more realistic than the balanced prior setting typically considered by researchers. Second, we consider adversaries that select inference thresholds according to their attack goals and develop a threshold selection procedure that improves inference attacks. Since previous inference attacks fail in imbalanced prior setting, we develop a new inference attack based on the intuition that inputs corresponding to training set members will be near a local minimum in the loss function, and show that an attack that combines this with thresholds on the per-instance loss can achieve high PPV even in settings where other attacks appear to be ineffective.