Goto

Collaborating Authors

 similar data


09ab23b6b607496f095feed7aaa1259b-AuthorFeedback.pdf

Neural Information Processing Systems

We cordially thank the reviewers for their time and thoughtful comments. Javanmard and Montanari paper we cited has a neurips 2013 version: "Confidence Intervals and Hypothesis Thank you for the suggestions. However, the reviewer is right that the we should make this point clearer in the revised version. Support recovery: the variable selection problem might be interpreted as support recovery. In contrast, FDR may be considered as a softer criterion for the quality of support recovery. Exact support recovery is not asymptotically feasible in the regime we consider.


Towards Understanding the Feasibility of Machine Unlearning

arXiv.org Artificial Intelligence

In light of recent privacy regulations, machine unlearning has attracted significant attention in the research community. However, current studies predominantly assess the overall success of unlearning approaches, overlooking the varying difficulty of unlearning individual training samples. As a result, the broader feasibility of machine unlearning remains under-explored. This paper presents a set of novel metrics for quantifying the difficulty of unlearning by jointly considering the properties of target model and data distribution. Specifically, we propose several heuristics to assess the conditions necessary for a successful unlearning operation, examine the variations in unlearning difficulty across different training samples, and present a ranking mechanism to identify the most challenging samples to unlearn. We highlight the effectiveness of the Kernelized Stein Discrepancy (KSD), a parameterized kernel function tailored to each model and dataset, as a heuristic for evaluating unlearning difficulty. Our approach is validated through multiple classification tasks and established machine unlearning algorithms, demonstrating the practical feasibility of unlearning operations across diverse scenarios. Machine Unlearning (MU) (Cao & Yang, 2015) refers to a process that enables machine learning (ML) models to remove specific training data and revert corresponding data influence on the trained models while preserving the models' generalization. Although existing machine unlearning studies vary based on diverse theoretical foundations, their performance evaluation metrics used are generally common, including 1) Data Erasure Completeness, 2) Unlearning Time Efficiency, 3) Resource Consumption, and 4) Privacy Preservation (Xu et al., 2024; Yang & Zhao, 2023; Shaik et al., 2023).


Similar Data Points Identification with LLM: A Human-in-the-loop Strategy Using Summarization and Hidden State Insights

arXiv.org Artificial Intelligence

This study introduces a simple yet effective method for identifying similar data points across non-free text domains, such as tabular and image data, using Large Language Models (LLMs). Our two-step approach involves data point summarization and hidden state extraction. Initially, data is condensed via summarization using an LLM, reducing complexity and highlighting essential information in sentences. Subsequently, the summarization sentences are fed through another LLM to extract hidden states, serving as compact, feature-rich representations. This approach leverages the advanced comprehension and generative capabilities of LLMs, offering a scalable and efficient strategy for similarity identification across diverse datasets. We demonstrate the effectiveness of our method in identifying similar data points on multiple datasets. Additionally, our approach enables non-technical domain experts, such as fraud investigators or marketing operators, to quickly identify similar data points tailored to specific scenarios, demonstrating its utility in practical applications. In general, our results open new avenues for leveraging LLMs in data analysis across various domains.


Mitigating Cold-start Forecasting using Cold Causal Demand Forecasting Model

arXiv.org Artificial Intelligence

Forecasting multivariate time series data, which involves predicting future values of variables over time using historical data, has significant practical applications. Although deep learning-based models have shown promise in this field, they often fail to capture the causal relationship between dependent variables, leading to less accurate forecasts. Additionally, these models cannot handle the cold-start problem in time series data, where certain variables lack historical data, posing challenges in identifying dependencies among variables. To address these limitations, we introduce the Cold Causal Demand Forecasting (CDF-cold) framework that integrates causal inference with deep learning-based models to enhance the forecasting accuracy of multivariate time series data affected by the cold-start problem. To validate the effectiveness of the proposed approach, we collect 15 multivariate time-series datasets containing the network traffic of different Google data centers. Our experiments demonstrate that the CDF-cold framework outperforms state-of-the-art forecasting models in predicting future values of multivariate time series data.


Article explores two types of machine learning methods. This algorithm is useful for image segmentation, customer segmentation, anomaly detection.

#artificialintelligence

Different learning methods and patterns are generally associated with the human mind. The visual, auditory, kinesthetic, and reading/writing methods of learning are widely recognized as the four primary methods by which humans learn. The utility of these learning methods varies from person to person. While Jack may learn more effectively by reading a book and writing key points from what he has learned, Jill may learn more effectively by doing and putting what she has learned into action, which is the kinesthetic form of learning. Machine learning models, like humans, can learn patterns in data in a variety of ways.


News - Research in Germany

#artificialintelligence

How can I prepare myself for something I do not yet know? Scientists from the Technical University of Munich and from the Fritz Haber Institute in Berlin have addressed this almost philosophical question in the context of machine learning. Learning is no more than drawing new decisions on prior experience. In order to deal with a new situation in this way, one needs to have dealt with roughly similar situations before. In machine learning, this correspondingly means that a learning algorithm needs to have been exposed to roughly similar data.


Unsupervised machine learning: Dealing with unknown data

#artificialintelligence

The unsupervised learning model of machine learning uses specific algorithms to deal with unclassified and unlabeled data. This Arcitura Education article explains the model, dimension reduction algorithms, concept of reinforcement learning and more.


Artificial Intelligence -- Pandect

#artificialintelligence

During the 21st century, the revolution in data storage techniques reduces the storage cost of the data as a result the amount of data generated is growing exponentially. It is estimated the by the end of the 21st we will have 44 zettabytes of data. Every action we perform generates data viz. The algorithm we are using such as Naïve Bayes, KNN clustering, etc. has roots back in the 1960s but due to the technology barrier was not able to implement this algorithm. But in the 21st-century lot of innovation has been taken place -- result hardware has been evolved.


Overview of Clustering Algorithms

#artificialintelligence

Clustering is an unsupervised technique in which the set of similar data points is grouped together to form a cluster. A Cluster is said to be good if the intra-cluster (the data points within the same cluster) similarity is high and the inter-cluster (the data points outside the cluster) similarity is low. Clustering could also be viewed as a Data Compression technique in which the data points of a cluster can be treated as a group. Clustering is also called Data Segmentation because it partitions the data such that a group of similar data points forms a cluster. Classification Algorithms are good techniques to distinguish between groups and classify.