Media
End-to-end topographic networks as models of cortical map formation and human visual behaviour: moving beyond convolutions
Lu, Zejin, Doerig, Adrien, Bosch, Victoria, Krahmer, Bas, Kaiser, Daniel, Cichy, Radoslaw M, Kietzmann, Tim C
Computational models are an essential tool for understanding the origin and functions of the topographic organisation of the primate visual system. Yet, vision is most commonly modelled by convolutional neural networks that ignore topography by learning identical features across space. Here, we overcome this limitation by developing All-Topographic Neural Networks (All-TNNs). Trained on visual input, several features of primate topography emerge in All-TNNs: smooth orientation maps and cortical magnification in their first layer, and category-selective areas in their final layer. In addition, we introduce a novel dataset of human spatial biases in object recognition, which enables us to directly link models to behaviour. We demonstrate that All-TNNs significantly better align with human behaviour than previous state-of-the-art convolutional models due to their topographic nature.
TrOMR:Transformer-Based Polyphonic Optical Music Recognition
Li, Yixuan, Liu, Huaping, Jin, Qiang, Cai, Miaomiao, Li, Peng
Optical Music Recognition (OMR) is an important technology in music and has been researched for a long time. Previous approaches for OMR are usually based on CNN for image understanding and RNN for music symbol classification. In this paper, we propose a transformer-based approach with excellent global perceptual capability for end-to-end polyphonic OMR, called TrOMR. We also introduce a novel consistency loss function and a reasonable approach for data annotation to improve recognition accuracy for complex music scores. Extensive experiments demonstrate that TrOMR outperforms current OMR methods, especially in real-world scenarios. We also develop a TrOMR system and build a camera scene dataset for full-page music scores in real-world. The code and datasets will be made available for reproducibility.
RLCD: Reinforcement Learning from Contrast Distillation for Language Model Alignment
Yang, Kevin, Klein, Dan, Celikyilmaz, Asli, Peng, Nanyun, Tian, Yuandong
We propose Reinforcement Learning from Contrast Distillation (RLCD), a method for aligning language models to follow natural language principles without using human feedback. RLCD trains a preference model using simulated preference pairs that contain both a high-quality and low-quality example, generated using contrasting positive and negative prompts. The preference model is then used to improve a base unaligned language model via reinforcement learning. Empirically, RLCD outperforms RLAIF (Bai et al., 2022b) and context distillation (Huang et al., 2022) baselines across three diverse alignment tasks--harmlessness, helpfulness, and story outline generation--and on both 7B and 30B model scales for preference data simulation. Reinforcement Learning from Human Feedback (RLHF) has recently been used to great effect to align pretrained large language models (LLMs) to human preferences, optimizing for desirable qualities like harmlessness and helpfulness (Bai et al., 2022a) and achieving ...
Dimension Independent Mixup for Hard Negative Sample in Collaborative Filtering
Wu, Xi, Yang, Liangwei, Gong, Jibing, Zhou, Chao, Lin, Tianyu, Liu, Xiaolong, Yu, Philip S.
To address this In the contemporary era of voluminous data [17], individuals are limitation, we propose Dimension Independent Mixup for Hard inundated with an incessant influx of content generated by the internet. Negative Sampling (DINS), which is the first Area-wise sampling To address the issue of information overload, Recommender method for training CF-based models. DINS comprises three modules: Systems (RecSys) are employed to assist users in locating the most Hard Boundary Definition, Dimension Independent Mixup, relevant information and are increasingly pivotal in online services and Multi-hop Pooling. Experiments with real-world datasets on such as news feed [30], music suggestion [5], and online shopping both matrix factorization and graph-based models demonstrate [9]. Collaborative filtering (CF) [13], a highly effective method that DINS outperforms other negative sampling methods, establishing that predicts a user's preference based on their past interactions, is its effectiveness and superiority. Our work contributes a new widely employed. The latest CF-based models [10, 28] incorporate perspective, introduces Area-wise sampling, and presents DINS historical interactions into condensed user/item vectors and predict as a novel approach that achieves state-of-the-art performance for a user's preference for each item based on the dot product of negative sampling.
A Shift In Artistic Practices through Artificial Intelligence
Tatar, Kฤฑvanรง, Ericson, Petter, Cotton, Kelsey, del Prado, Paola Torres Nรบรฑez, Batlle-Roca, Roser, Cabrero-Daniel, Beatriz, Ljungblad, Sara, Diapoulis, Georgios, Hussain, Jabbar
The explosion of content generated by Artificial Intelligence models has initiated a cultural shift in arts, music, and media, where roles are changing, values are shifting, and conventions are challenged. The readily available, vast dataset of the internet has created an environment for AI models to be trained on any content on the web. With AI models shared openly, and used by many, globally, how does this new paradigm shift challenge the status quo in artistic practices? What kind of changes will AI technology bring into music, arts, and new media?
Perceptions and Realities of Text-to-Image Generation
Oppenlaender, Jonas, Silvennoinen, Johanna, Paananen, Ville, Visuri, Aku
Generative artificial intelligence (AI) is a widely popular technology that will have a profound impact on society and individuals. Less than a decade ago, it was thought that creative work would be among the last to be automated - yet today, we see AI encroaching on many creative domains. In this paper, we present the findings of a survey study on people's perceptions of text-to-image generation. We touch on participants' technical understanding of the emerging technology, their fears and concerns, and thoughts about risks and dangers of text-to-image generation to the individual and society. We find that while participants were aware of the risks and dangers associated with the technology, only few participants considered the technology to be a personal risk. The risks for others were more easy to recognize for participants. Artists were particularly seen at risk. Interestingly, participants who had tried the technology rated its future importance lower than those who had not tried it. This result shows that many people are still oblivious of the potential personal risks of generative artificial intelligence and the impending societal changes associated with this technology.
A Survey on Large Language Models for Recommendation
Wu, Likang, Zheng, Zhi, Qiu, Zhaopeng, Wang, Hao, Gu, Hongchao, Shen, Tingjia, Qin, Chuan, Zhu, Chen, Zhu, Hengshu, Liu, Qi, Xiong, Hui, Chen, Enhong
Large Language Models (LLMs) have emerged as powerful tools in the field of Natural Language Processing (NLP) and have recently gained significant attention in the domain of Recommendation Systems (RS). These models, trained on massive amounts of data using self-supervised learning, have demonstrated remarkable success in learning universal representations and have the potential to enhance various aspects of recommendation systems by some effective transfer techniques such as fine-tuning and prompt tuning, and so on. The crucial aspect of harnessing the power of language models in enhancing recommendation quality is the utilization of their high-quality representations of textual features and their extensive coverage of external knowledge to establish correlations between items and users. To provide a comprehensive understanding of the existing LLM-based recommendation systems, this survey presents a taxonomy that categorizes these models into two major paradigms, respectively Discriminative LLM for Recommendation (DLLM4Rec) and Generative LLM for Recommendation (GLLM4Rec), with the latter being systematically sorted out for the first time. Furthermore, we systematically review and analyze existing LLM-based recommendation systems within each paradigm, providing insights into their methodologies, techniques, and performance. Additionally, we identify key challenges and several valuable findings to provide researchers and practitioners with inspiration. We have also created a GitHub repository to index relevant papers on LLMs for recommendation, https://github.com/WLiK/LLM4Rec.
EgoHumans: An Egocentric 3D Multi-Human Benchmark
Khirodkar, Rawal, Bansal, Aayush, Ma, Lingni, Newcombe, Richard, Vo, Minh, Kitani, Kris
We present EgoHumans, a new multi-view multi-human video benchmark to advance the state-of-the-art of egocentric human 3D pose estimation and tracking. Existing egocentric benchmarks either capture single subject or indoor-only scenarios, which limit the generalization of computer vision algorithms for real-world applications. We propose a novel 3D capture setup to construct a comprehensive egocentric multi-human benchmark in the wild with annotations to support diverse tasks such as human detection, tracking, 2D/3D pose estimation, and mesh recovery. We leverage consumer-grade wearable camera-equipped glasses for the egocentric view, which enables us to capture dynamic activities like playing tennis, fencing, volleyball, etc. Furthermore, our multi-view setup generates accurate 3D ground truth even under severe or complete occlusion. The dataset consists of more than 125k egocentric images, spanning diverse scenes with a particular focus on challenging and unchoreographed multi-human activities and fast-moving egocentric views. We rigorously evaluate existing state-of-the-art methods and highlight their limitations in the egocentric scenario, specifically on multi-human tracking. To address such limitations, we propose EgoFormer, a novel approach with a multi-stream transformer architecture and explicit 3D spatial reasoning to estimate and track the human pose. EgoFormer significantly outperforms prior art by 13.6% IDF1 on the EgoHumans dataset.
The "-ification" of Everything
A half-formed thought feels worse than an empty head--the tip-of-the-tongue sensation, the inkling of a there there without the foggiest notion of how to get, well, there. Especially dire is when the "what" that we wish to articulate feels half-formed itself, something observable yet emergent, for which the masses have yet to find language. But all we have is language, of course, and so we must muddle through, reaching for a word to serve as a placeholder for our idea until something better comes along. Some would say that finding new language is the work of scholars, but in the age of the Internet we may have lost track of who is leading whom. However provisional, the placeholders sometimes stick.
How to silence Amazon Alexa's 'by the way' suggestions
Kurt "The CyberGuy" Knutsson provides tips on how to limit the device's notifications. Do you ever feel like your Alexa device is listening to you a little too much? Do you wish you could have more control over what it says and when it says it? It's great that they can be set up to lock our doors, turn off our lights or give us the weather. STAY UPDATED WITH KURT'S FREE CYBERGUY NEWSLETTER TO GET SECURITY ALERTS, QUICK TIPS, TECH REVIEWS AND EASY HOW-TO'S TO MAKE YOU SMARTER What I don't appreciate about Alexa devices, however, is that they sometimes can give us extra information that we never asked for, which can be annoying.