Goto

Collaborating Authors

 Education


When does the student surpass the teacher? Federated Semi-supervised Learning with Teacher-Student EMA

arXiv.org Artificial Intelligence

Semi-Supervised Learning (SSL) has received extensive attention in the domain of computer vision, leading to development of promising approaches such as FixMatch. In scenarios where training data is decentralized and resides on client devices, SSL must be integrated with privacy-aware training techniques such as Federated Learning. We consider the problem of federated image classification and study the performance and privacy challenges with existing federated SSL (FSSL) approaches. Firstly, we note that even state-of-the-art FSSL algorithms can trivially compromise client privacy and other real-world constraints such as client statelessness and communication cost. Secondly, we observe that it is challenging to integrate EMA (Exponential Moving Average) updates into the federated setting, which comes at a trade-off between performance and communication cost. We propose a novel approach FedSwitch, that improves privacy as well as generalization performance through Exponential Moving Average (EMA) updates. FedSwitch utilizes a federated semi-supervised teacher-student EMA framework with two features - local teacher adaptation and adaptive switching between teacher and student for pseudo-label generation. Our proposed approach outperforms the state-of-the-art on federated image classification, can be adapted to real-world constraints, and achieves good generalization performance with minimal communication cost overhead.


Semi-Automated Construction of Food Composition Knowledge Base

arXiv.org Artificial Intelligence

A food composition knowledge base, which stores the essential phyto-, micro-, and macro-nutrients of foods is useful for both research and industrial applications. Although many existing knowledge bases attempt to curate such information, they are often limited by time-consuming manual curation processes. Outside of the food science domain, natural language processing methods that utilize pre-trained language models have recently shown promising results for extracting knowledge from unstructured text. In this work, we propose a semi-automated framework for constructing a knowledge base of food composition from the scientific literature available online. To this end, we utilize a pre-trained BioBERT language model in an active learning setup that allows the optimal use of limited training data. Our work demonstrates how human-in-the-loop models are a step toward AI-assisted food systems that scale well to the ever-increasing big data.


Mathematics, word problems, common sense, and artificial intelligence

arXiv.org Artificial Intelligence

The paper discusses the capacities and limitations of current artificial intelligence (AI) technology to solve word problems that combine elementary knowledge with commonsense reasoning. No existing AI systems can solve these reliably. We review three approaches that have been developed, using AI natural language technology: outputting the answer directly, outputting a computer program that solves the problem, and outputting a formalized representation that can be input to an automated theorem verifier. We review some benchmarks that have been developed to evaluate these systems and some experimental studies. We discuss the limitations of the existing technology at solving these kinds of problems. We argue that it is not clear whether these kinds of limitations will be important in developing AI technology for pure mathematical research, but that they will be important in applications of mathematics, and may well be important in developing programs capable of reading and understanding mathematical content written by humans.


Communication-Efficient Diffusion Strategy for Performance Improvement of Federated Learning with Non-IID Data

arXiv.org Artificial Intelligence

Federated learning (FL) is a novel learning paradigm that addresses the privacy leakage challenge of centralized learning. However, in FL, users with non-independent and identically distributed (non-IID) characteristics can deteriorate the performance of the global model. Specifically, the global model suffers from the weight divergence challenge owing to non-IID data. To address the aforementioned challenge, we propose a novel diffusion strategy of the machine learning (ML) model (FedDif) to maximize the FL performance with non-IID data. In FedDif, users spread local models to neighboring users over D2D communications. FedDif enables the local model to experience different distributions before parameter aggregation. Furthermore, we theoretically demonstrate that FedDif can circumvent the weight divergence challenge. On the theoretical basis, we propose the communication-efficient diffusion strategy of the ML model, which can determine the trade-off between the learning performance and communication cost based on auction theory. The performance evaluation results show that FedDif improves the test accuracy of the global model by 10.37% compared to the baseline FL with non-IID settings. Moreover, FedDif improves the number of consumed sub-frames by 1.28 to 2.85 folds to the latest methods except for the model compression scheme. FedDif also improves the number of transmitted models by 1.43 to 2.67 folds to the latest methods.


ESTAS: Effective and Stable Trojan Attacks in Self-supervised Encoders with One Target Unlabelled Sample

arXiv.org Artificial Intelligence

Emerging self-supervised learning (SSL) has become a popular image representation encoding method to obviate the reliance on labeled data and learn rich representations from large-scale, ubiquitous unlabelled data. Then one can train a downstream classifier on top of the pre-trained SSL image encoder with few or no labeled downstream data. Although extensive works show that SSL has achieved remarkable and competitive performance on different downstream tasks, its security concerns, e.g, Trojan attacks in SSL encoders, are still not well-studied. In this work, we present a novel Trojan Attack method, denoted by ESTAS, that can enable an effective and stable attack in SSL encoders with only one target unlabeled sample. In particular, we propose consistent trigger poisoning and cascade optimization in ESTAS to improve attack efficacy and model accuracy, and eliminate the expensive target-class data sample extraction from large-scale disordered unlabelled data. Our substantial experiments on multiple datasets show that ESTAS stably achieves > 99% attacks success rate (ASR) with one target-class sample. Compared to prior works, ESTAS attains > 30% ASR increase and > 8.3% accuracy improvement on average.


XNLI: Explaining and Diagnosing NLI-based Visual Data Analysis

arXiv.org Artificial Intelligence

Natural language interfaces (NLIs) enable users to flexibly specify analytical intentions in data visualization. However, diagnosing the visualization results without understanding the underlying generation process is challenging. Our research explores how to provide explanations for NLIs to help users locate the problems and further revise the queries. We present XNLI, an explainable NLI system for visual data analysis. The system introduces a Provenance Generator to reveal the detailed process of visual transformations, a suite of interactive widgets to support error adjustments, and a Hint Generator to provide query revision hints based on the analysis of user queries and interactions. Two usage scenarios of XNLI and a user study verify the effectiveness and usability of the system. Results suggest that XNLI can significantly enhance task accuracy without interrupting the NLI-based analysis process.


Writing Biometrics and Academic Integrity โ€“ Cursive Technology, Inc.

#artificialintelligence

The digital footprint of who is sitting in front of a computer today may be detected in more ways than one might expect. Beyond just user authentication, this includes, IP address, geolocation, internet service provider, internet cookies, ping time, and ability to complete complex tasks. CAPTCHA, also reCAPTCHA software use a number of these strategies to determine if you are a bot pretending to be a human, or an actual human. These systems have become increasing more sophisticated as the developers of these bots are able to fool CAPTCHA tasks, such as selecting traffic lights in a set of images automatically without the need for a human. In the academic space, this has hardly been an issue.


Microsoft Invests Billions In ChatGPT Firm OpenAI

International Business Times

Microsoft on Monday said it had extended its partnership with OpenAI, the research lab and creator of ChatGPT, an artificial intelligence chatbot that has sparked widespread fears of cheating in schools and universities. In a company blog post tweeted by CEO Satya Nadella, the tech giant announced a "multiyear, multibillion dollar investment to accelerate AI breakthroughs" that would be "broadly shared with the world." OpenAI's ChatGPT became an internet sensation when it was released without warning in November, allowing users to experiment with its ability to write essays, articles and poems as well as computer code in just seconds. With teachers alarmed by its ability, ChatGPT is banned in universities and school districts - including in New York City and Washington DC - and has sparked nervous debates about the future of office work. California-based OpenAI is also the creator of DALL-E, a program that can swiftly draw up digital images and illustrations at a simple request.


From Data Collection to Model Deployment: 6 Stages of a Data Science Project - KDnuggets

#artificialintelligence

Additionally, the chance is you won't be working with a dataset, so merging data is also a common operation you'll use. Extracting meaningful information from data becomes easier if you visualize it. In Python, there are many libraries you can use to visualize your data. You should use this stage to detect the outliers and correlated predictors. If undetected, they will decrease your machine-learning model performance.


Data Science Learning

#artificialintelligence

A Data Science course is a educational program that focuses on teaching students the skills and knowledge needed to work in the field of data science. This can include topics such as statistics, programming, machine learning, data visualization, and more. A Data Science course may be offered at the undergraduate or graduate level and can be a part of a degree program or a standalone course. The course duration can vary, it can be a few weeks long, few months or a full semester. Data Science courses aim to provide students with a comprehensive understanding of the field, including both the theoretical and practical aspects.