Oceania
A Provably Secure Strong PUF based on LWE: Construction and Implementation
Xi, Xiaodan, Li, Ge, Wang, Ye, Jeon, Yeonsoo, Orshansky, Michael
We construct a strong PUF with provable security against ML attacks on both classical and quantum computers. The security is guaranteed by the cryptographic hardness of learning decryption functions of public-key cryptosystems, and the hardness of the learning-with-errors (LWE) problem defined on integer lattices. We call our construction the lattice PUF. We construct lattice PUF with a physically obfuscated key and an LWE decryption function block. To allow deployments in different scenarios, we demonstrate designs with different latency-area trade-offs. A compact design uses a highly serialized LFSR and LWE decryption function, while a latency-optimized design uses an unrolled LFSR and a parallel datapath. In addition to theoretical security guarantee, we evaluate empirical resistance to the various leading ML techniques: the prediction error remains above 49.76% after 1 million training CRPs. The resource-efficient design requires only 45 slices for the PUF logic proper, and 351 slices for a fuzzy extractor. The latency-optimized design achieves a 148X reduction in latency, at a 10X increase in PUF hardware utilization. The mean uniformity of PUF responses is 49.98%, the mean uniqueness is 50.00%, and the mean reliability is 1.26%. ILICON physical unclonable functions (PUFs) are security primitives commonly adopted for device identification, authentication, and cryptographic key generation [38]. A PUF exploits the inherent randomness of CMOS technology to generate an output response for a given input challenge. Weak PUFs, which are also called physically obfuscated keys (POKs) [15], have a limited challenge-response pair (CRP) space. The security of a strong PUF requires the associated CRPs to be unpredictable: given a certain set of known CRPs, it should be hard to predict the unobserved CRPs, even with the most powerful machine learning (ML) based modeling attacks. Engineering an ML resistant strong PUF with low hardware cost has been challenging. Variants of the original arbiter PUF (APUF) with stronger modeling attack resilience, including bistable ring PUF and feedforward APUF, have also been broken via ML attacks [37], [35]. The recent interpose PUF (IPUF) [33] proposal is claimed to have provable ML resistance.
Learned Lossless Compression for JPEG via Frequency-Domain Prediction
Luo, Jixiang, Li, Shaohui, Dai, Wenrui, Li, Chenglin, Zou, Junni, Xiong, Hongkai
JPEG images can be further compressed to enhance the storage and transmission of large-scale image datasets. Existing learned lossless compressors for RGB images cannot be well transferred to JPEG images due to the distinguishing distribution of DCT coefficients and raw pixels. In this paper, we propose a novel framework for learned lossless compression of JPEG images that achieves end-to-end optimized prediction of the distribution of decoded DCT coefficients. To enable learning in the frequency domain, DCT coefficients are partitioned into groups to utilize implicit local redundancy. An autoencoder-like architecture is designed based on the weight-shared blocks to realize entropy modeling of grouped DCT coefficients and independently compress the priors. We attempt to realize learned lossless compression of JPEG images in the frequency domain. Experimental results demonstrate that the proposed framework achieves superior or comparable performance in comparison to most recent lossless compressors with handcrafted context modeling for JPEG images.
Looking for a Needle in a Haystack: A Comprehensive Study of Hallucinations in Neural Machine Translation
Guerreiro, Nuno M., Voita, Elena, Martins, André F. T.
Although the problem of hallucinations in neural machine translation (NMT) has received some attention, research on this highly pathological phenomenon lacks solid ground. Previous work has been limited in several ways: it often resorts to artificial settings where the problem is amplified, it disregards some (common) types of hallucinations, and it does not validate adequacy of detection heuristics. In this paper, we set foundations for the study of NMT hallucinations. First, we work in a natural setting, i.e., in-domain data without artificial noise neither in training nor in inference. Next, we annotate a dataset of over 3.4k sentences indicating different kinds of critical errors and hallucinations. Then, we turn to detection methods and both revisit methods used previously and propose using glass-box uncertainty-based detectors. Overall, we show that for preventive settings, (i) previously used methods are largely inadequate, (ii) sequence log-probability works best and performs on par with reference-based methods. Finally, we propose DeHallucinator, a simple method for alleviating hallucinations at test time that significantly reduces the hallucinatory rate. To ease future research, we release our annotated dataset for WMT18 German-English data, along with the model, training data, and code.
Mixed-Precision Neural Network Quantization via Learned Layer-wise Importance
Tang, Chen, Ouyang, Kai, Wang, Zhi, Zhu, Yifei, Wang, Yaowei, Ji, Wen, Zhu, Wenwu
The exponentially large discrete search space in mixed-precision quantization (MPQ) makes it hard to determine the optimal bit-width for each layer. Previous works usually resort to iterative search methods on the training set, which consume hundreds or even thousands of GPU-hours. In this study, we reveal that some unique learnable parameters in quantization, namely the scale factors in the quantizer, can serve as importance indicators of a layer, reflecting the contribution of that layer to the final accuracy at certain bit-widths. These importance indicators naturally perceive the numerical transformation during quantization-aware training, which can precisely provide quantization sensitivity metrics of layers. However, a deep network always contains hundreds of such indicators, and training them one by one would lead to an excessive time cost. To overcome this issue, we propose a joint training scheme that can obtain all indicators at once. It considerably speeds up the indicators training process by parallelizing the original sequential training processes. With these learned importance indicators, we formulate the MPQ search problem as a one-time integer linear programming (ILP) problem. That avoids the iterative search and significantly reduces search time without limiting the bit-width search space. For example, MPQ search on ResNet18 with our indicators takes only 0.06 s, which improves time efficiency exponentially compared to iterative search methods. Also, extensive experiments show our approach can achieve SOTA accuracy on ImageNet for far-ranging models with various constraints (e.g., BitOps, compress rate). Code is available on https://github.com/1hunters/LIMPQ.
A Multi-Grained Self-Interpretable Symbolic-Neural Model For Single/Multi-Labeled Text Classification
Hu, Xiang, Kong, Xinyu, Tu, Kewei
Deep neural networks based on layer-stacking architectures have historically suffered from poor inherent interpretability. Meanwhile, symbolic probabilistic models function with clear interpretability, but how to combine them with neural networks to enhance their performance remains to be explored. In this paper, we try to marry these two systems for text classification via a structured language model. We propose a Symbolic-Neural model that can learn to explicitly predict class labels of text spans from a constituency tree without requiring any access to span-level gold labels. As the structured language model learns to predict constituency trees in a self-supervised manner, only raw texts and sentence-level labels are required as training data, which makes it essentially a general constituent-level self-interpretable classification model. Our experiments demonstrate that our approach could achieve good prediction accuracy in downstream tasks. Meanwhile, the predicted span labels are consistent with human rationales to a certain degree.
Nebraska joins international effort to enhance artificial intelligence
Nebraska's Hau Chan has been selected to be part of an international research effort focused on the ethical deployment of artificial intelligence. The project is part of a broader collaboration between the National Science Foundation and CSIRO (Australia's national science agency) to fund groundbreaking artificial intelligence research that ultimately solves environmental and societal issues. The University of Nebraska–Lincoln will lead U.S. research efforts in collaboration with the New York-based Rensselaer Polytechnic Institute and the University of New South Wales. The work will concentrate on the development of AI-powered solutions to drought, harmful environmental emissions and infectious diseases. Chan, assistant professor in the School of Computing, will serve as principal investigator on a project that will use AI to determine appropriate allocation of resources such as water, vaccines, medical supplies and non-fossil fuel vehicle stations.
Why is Britain experiencing so many earthquakes? Experts weigh in
From Cornwall and Wales to Essex, Blackpool and the Norfolk coast, Britain has experienced a flurry of earthquakes in the past month. The biggest – a 3.8 magnitude tremor that struck Wales on February 24 – sparked panic as locals reported their beds started to move and walls shook. One resident in the small Welsh town of Abertillery not far from the epicentre said the quake was so noticeable'it felt like the roof was falling off'. The Welsh quake was preceded by several more including a 1.5 magnitude quake in Cornwall and a 3.8 magnitude event off the coast of Great Yarmouth. Here's all you need to know about the British tremors – including whether recent tectonic activity suggests a'big one' is soon to hit parts of the country.
What does religion have to say about artificial intelligence? - Los Angeles Times
Sometimes Rabbi Joshua Franklin knows exactly what he wants to talk about in his weekly Shabbat sermons -- other times, not so much. It was on one of those not-so-much days on a cold afternoon in late December that the spiritual leader of the Jewish Center of the Hamptons decided to turn to Artificial Intelligence. Franklin, 38, who has dark wavy hair and a friendly vibe, knew that OpenAI's new ChatGPT program could write sonnets in the style of Shakespeare and songs in the style of Taylor Swift. Now, he wondered if it could write a sermon in the style of a rabbi. So he gave it a prompt: "Write a sermon, in the voice of a rabbi, about 1,000 words, connecting the Torah portion this week with the idea of intimacy and vulnerability, quoting Brené Brown" -- the bestselling author and researcher known for her work on vulnerability, shame and empathy.
UK Supreme Court hears landmark patent case over AI "inventor"
LONDON (Reuters) – An American computer scientist on Thursday urged the United Kingdom's Supreme Court to rule he is entitled to patents over inventions created by his artificial intelligence system, in a landmark case about whether AI can own patent rights. Stephen Thaler wants to be granted two patents in the UK over inventions he says were devised by his "creativity machine" called DABUS. His attempt to register the patents was refused on the grounds that the inventor must be a human or a company, rather than a machine. Thaler's lawyer Robert Jehan told the Supreme Court in London that Thaler is "entitled to the rights of the DABUS inventions" because there is no requirement under UK patent law that an invention "must have a human inventor to be patentable". He argued in court filings that the owner of an AI system is "entitled to inventions generated by the system and to the grant of patents for those inventions if patentable". But lawyers representing the UK's Intellectual Property Office, which initially refused Thaler's applications in 2019, argued the appeal should be dismissed.
Prototype-Guided Memory Replay for Continual Learning
Ho, Stella, Liu, Ming, Du, Lan, Gao, Longxiang, Xiang, Yong
Continual learning (CL) refers to a machine learning paradigm that learns continuously without forgetting previously acquired knowledge. Thereby, major difficulty in CL is catastrophic forgetting of preceding tasks, caused by shifts in data distributions. Existing CL models often save a large number of old examples and stochastically revisit previously seen data to retain old knowledge. However, the occupied memory size keeps enlarging along with accumulating seen data. Hereby, we propose a memory-efficient CL method by storing a few samples to achieve good performance. We devise a dynamic prototype-guided memory replay module and incorporate it into an online meta-learning model. We conduct extensive experiments on text classification and investigate the effect of training set orders on CL model performance. The experimental results testify the superiority of our method in terms of forgetting mitigation and efficiency.