Goto

Collaborating Authors

 Government


Node Injection Link Stealing Attack

arXiv.org Artificial Intelligence

In this paper, we present a stealthy and effective attack that exposes privacy vulnerabilities in Graph Neural Networks (GNNs) by inferring private links within graph-structured data. Focusing on the inductive setting where new nodes join the graph and an API is used to query predictions, we investigate the potential leakage of private edge information. We also propose methods to preserve privacy while maintaining model utility. Our attack demonstrates superior performance in inferring the links compared to the state of the art. Furthermore, we examine the application of differential privacy (DP) mechanisms to mitigate the impact of our proposed attack, we analyze the trade-off between privacy preservation and model utility. Our work highlights the privacy vulnerabilities inherent in GNNs, underscoring the importance of developing robust privacy-preserving mechanisms for their application.


Fundamental causal bounds of quantum random access memories

arXiv.org Artificial Intelligence

Quantum devices should operate in adherence to quantum physics principles. Quantum random access memory (QRAM), a fundamental component of many essential quantum algorithms for tasks such as linear algebra, data search, and machine learning, is often proposed to offer $\mathcal{O}(\log N)$ circuit depth for $\mathcal{O}(N)$ data size, given $N$ qubits. However, this claim appears to breach the principle of relativity when dealing with a large number of qubits in quantum materials interacting locally. In our study we critically explore the intrinsic bounds of rapid quantum memories based on causality, employing the relativistic quantum field theory and Lieb-Robinson bounds in quantum many-body systems. In this paper, we consider a hardware-efficient QRAM design in hybrid quantum acoustic systems. Assuming clock cycle times of approximately $10^{-3}$ seconds and a lattice spacing of about 1 micrometer, we show that QRAM can accommodate up to $\mathcal{O}(10^7)$ logical qubits in 1 dimension, $\mathcal{O}(10^{15})$ to $\mathcal{O}(10^{20})$ in various 2D architectures, and $\mathcal{O}(10^{24})$ in 3 dimensions. We contend that this causality bound broadly applies to other quantum hardware systems. Our findings highlight the impact of fundamental quantum physics constraints on the long-term performance of quantum computing applications in data science and suggest potential quantum memory designs for performance enhancement.


Embedding Models for Supervised Automatic Extraction and Classification of Named Entities in Scientific Acknowledgements

arXiv.org Artificial Intelligence

Acknowledgments in scientific papers may give an insight into aspects of the scientific community, such as reward systems, collaboration patterns, and hidden research trends. The aim of the paper is to evaluate the performance of different embedding models for the task of automatic extraction and classification of acknowledged entities from the acknowledgment text in scientific papers. We trained and implemented a named entity recognition (NER) task using the Flair NLP framework. The training was conducted using three default Flair NER models with four differently-sized corpora and different versions of the Flair NLP framework. The Flair Embeddings model trained on the medium corpus with the latest FLAIR version showed the best accuracy of 0.79. Expanding the size of a training corpus from very small to medium size massively increased the accuracy of all training algorithms, but further expansion of the training corpus did not bring further improvement. Moreover, the performance of the model slightly deteriorated. Our model is able to recognize six entity types: funding agency, grant number, individuals, university, corporation, and miscellaneous. The model works more precisely for some entity types than for others; thus, individuals and grant numbers showed a very good F1-Score over 0.9. Most of the previous works on acknowledgment analysis were limited by the manual evaluation of data and therefore by the amount of processed data. This model can be applied for the comprehensive analysis of acknowledgment texts and may potentially make a great contribution to the field of automated acknowledgment analysis.


Learning Regions of Interest for Bayesian Optimization with Adaptive Level-Set Estimation

arXiv.org Artificial Intelligence

We study Bayesian optimization (BO) in high-dimensional and non-stationary scenarios. Existing algorithms for such scenarios typically require extensive hyperparameter tuning, which limits their practical effectiveness. We propose a framework, called BALLET, which adaptively filters for a high-confidence region of interest (ROI) as a superlevel-set of a nonparametric probabilistic model such as a Gaussian process (GP). Our approach is easy to tune, and is able to focus on local region of the optimization space that can be tackled by existing BO methods. The key idea is to use two probabilistic models: a coarse GP to identify the ROI, and a localized GP for optimization within the ROI. We show theoretically that BALLET can efficiently shrink the search space, and can exhibit a tighter regret bound than standard BO without ROI filtering. We demonstrate empirically the effectiveness of BALLET on both synthetic and real-world optimization tasks.


Analyzing Chain-of-Thought Prompting in Large Language Models via Gradient-based Feature Attributions

arXiv.org Artificial Intelligence

Chain-of-thought (CoT) prompting has been shown to empirically improve the accuracy of large language models (LLMs) on various question answering tasks. While understanding why CoT prompting is effective is crucial to ensuring that this phenomenon is a consequence of desired model behavior, little work has addressed this; nonetheless, such an understanding is a critical prerequisite for responsible model deployment. We address this question by leveraging gradient-based feature attribution methods which produce saliency scores that capture the influence of input tokens on model output. Specifically, we probe several open-source LLMs to investigate whether CoT prompting affects the relative importances they assign to particular input tokens. Our results indicate that while CoT prompting does not increase the magnitude of saliency scores attributed to semantically relevant tokens in the prompt compared to standard few-shot prompting, it increases the robustness of saliency scores to question perturbations and variations in model output.


Curvature-based Transformer for Molecular Property Prediction

arXiv.org Artificial Intelligence

The prediction of molecular properties is one of the most important and challenging tasks in the field of artificial intelligence-based drug design. Among the current mainstream methods, the most commonly used feature representation for training DNN models is based on SMILES and molecular graphs, although these methods are concise and effective, they also limit the ability to capture spatial information. In this work, we propose Curvature-based Transformer to improve the ability of Graph Transformer neural network models to extract structural information on molecular graph data by introducing Discretization of Ricci Curvature. To embed the curvature in the model, we add the curvature information of the graph as positional Encoding to the node features during the attention-score calculation. This method can introduce curvature information from graph data without changing the original network architecture, and it has the potential to be extended to other models. We performed experiments on chemical molecular datasets including PCQM4M-LST, MoleculeNet and compared with models such as Uni-Mol, Graphormer, and the results show that this method can achieve the state-of-the-art results. It is proved that the discretized Ricci curvature also reflects the structural and functional relationship while describing the local geometry of the graph molecular data.


Cross-inhibition leads to group consensus despite the presence of strongly opinionated minorities and asocial behaviour

arXiv.org Artificial Intelligence

Strongly opinionated minorities can have a dramatic impact on the opinion dynamics of a large population. Two factions of inflexible minorities, polarised into two competing opinions, could lead the entire population to persistent indecision. Equivalently, populations can remain undecided when individuals sporadically change their opinion based on individual information rather than social information. Our analysis compares the cross-inhibition model with the voter model for decisions between equally good alternatives, and with the weighted voter model for decisions among alternatives characterised by different qualities. Here we show that cross-inhibition, differently from the other two models, is a simple mechanism, ubiquitous in collective biological systems, that allows the population to reach a stable majority for one alternative even in the presence of asocial behaviour. The results predicted by the mean-field models are confirmed by experiments with swarms of 100 locally interacting robots. This work suggests an answer to the longstanding question of why inhibitory signals are widespread in natural systems of collective decision making, and, at the same time, it proposes an efficient mechanism for designing resilient swarms of minimalistic robots.


EXCLUSIVE: This is what AI REALLY thinks of us: DailyMail.com asked tech to depict average person in states across America... the results were not so flattering

Daily Mail - Science & tech

Artificial intelligence may not be sentient yet, but complex machine-learning algorithms like ChatGPT are slowly but surely developing their own opinions and prejudices about us. Midjourney, an AI program that creates images from textual descriptions, has some unusual and sometimes comically simplistic ideas on what makes the quintessential American resident of each US state. Now in its fifth version, Midjourney's inner workings are a closely held trade secret of the non-profit research lab that created the AI, unlike its text-to-image competitors DALL-E and Stable Diffusion, which use an open-source model. Each text-to-image request yielded four images from which we selected the most accurate or - failing that - the most subjectively interesting. The AI-generated images of men from D.C. were also ostentatiously dressed for politics and punditry Midjourney appears to intuitively believe that the vast majority of women in our nation's capitol skew older.


Revealed: The careers that face the highest risk of being replaced by AI - so will a robot take YOUR job?

Daily Mail - Science & tech

With the boom in popularity of artificial intelligence (AI), attention has quickly turned to the impact such innovation could have on the jobs market. There are fears that thousands of human roles may soon disappear because of huge advances in automation, with it emerging only last month that the UK Government privately thinks a'substantial number' of civil service jobs will soon be obsolete. Not to mention there is also a growing Silicon Valley civil war about whether rapidly evolving AI technology is a good thing or a bad thing. Well, research suggests that air traffic controllers, midwives, librarians and those with a career in sales have little to worry about, but if you work behind a bar, as a window cleaner or in customer service, the news isn't quite so positive. Nor is it for waiters and waitresses, who at 72 per cent are at the highest risk of having their roles carried out by a robot, according to digital media company DailyAI.com.


Does Sam Altman Know What He's Creating?

The Atlantic - Technology

On a Monday morning in April, Sam Altman sat inside OpenAI's San Francisco headquarters, telling me about a dangerous artificial intelligence that his company had built but would never release. His employees, he later said, often lose sleep worrying about the AIs they might one day release without fully appreciating their dangers. With his heel perched on the edge of his swivel chair, he looked relaxed. The powerful AI that his company had released in November had captured the world's imagination like nothing in tech's recent history. There was grousing in some quarters about the things ChatGPT could not yet do well, and in others about the future it may portend, but Altman wasn't sweating it; this was, for him, a moment of triumph. Check out more from this issue and find your next story to read. In small doses, Altman's large blue eyes emit a beam of earnest intellectual attention, and he seems to understand that, in large doses, their intensity might unsettle. In this case, he was ...