Goto

Collaborating Authors

 subconscious


SurfaceLogicKV: Surface and Logic Attention Behaviors are All You Need for Robust KV Cache Compression

Li, Mengjie, Song, William J.

arXiv.org Artificial Intelligence

The increasing input sequence length in Large Language Models (LLMs) puts significant pressure on key-value (KV) cache storage, making efficient inference challenging. Explicitly distinguishing attention behavior into our self-defined surface memorization and logic construction reveals essential roles in long-context reasoning. We observe that an individual attention head can display various behaviors, with nearly 98.5% effectively ignoring completely irrelevant information. The remaining 1.5% behaves as logic construction, and 0.5% behaves as surface memorization. Based on layer- and head-wise integration, we propose a novel two-stage SurfaceLogicKV method to utilize these attention behaviors for KV Cache compression. As a result, it achieves improved compressing robustness while maintaining competitive performance across various tasks and long sequences compared to baselines or even FullKV in some specific situations


I'm a mind control expert... here's how woke elites are controlling us like robots

Daily Mail - Science & tech

Are governments and Hollywood films secretly pumping people's minds full of messages which push obedience, alcohol addiction, and disseminate'woke' theories? It's long been known that world governments are fascinated by mind control, with groups like the Central Intelligence Agency (CIA) allegedly conducting sinister experiments on the public. In the 1950s and 60s, the CIA's infamous MKUltra program recruited civilians, mental patients, and drug addicts in an effort to reprogram minds. However, some believe social media has given world governments and entertainment giants new tools to control minds. This includes mind control expert Jason Christoff.


Subconscious Robotic Imitation Learning

Xie, Jun, Wang, Zhicheng, Tan, Jianwei, Lin, Huanxu, Ma, Xiaoguang

arXiv.org Artificial Intelligence

Although robotic imitation learning (RIL) is promising for embodied intelligent robots, existing RIL approaches rely on computationally intensive multi-model trajectory predictions, resulting in slow execution and limited real-time responsiveness. Instead, human beings subconscious can constantly process and store vast amounts of information from their experiences, perceptions, and learning, allowing them to fulfill complex actions such as riding a bike, without consciously thinking about each. Inspired by this phenomenon in action neurology, we introduced subconscious robotic imitation learning (SRIL), wherein cognitive offloading was combined with historical action chunkings to reduce delays caused by model inferences, thereby accelerating task execution. This process was further enhanced by subconscious downsampling and pattern augmented learning policy wherein intent-rich information was addressed with quantized sampling techniques to improve manipulation efficiency. Experimental results demonstrated that execution speeds of the SRIL were 100\% to 200\% faster over SOTA policies for comprehensive dual-arm tasks, with consistently higher success rates.


Another Crab's Treasure: this indie hit has clawed its way into my subconscious

The Guardian

The Arcane Kids, a video game collective from Los Angeles, have a manifesto that I think about all the time, but particularly when I find art that surprises me, or approaches traditional formats in new and exciting ways. The second line simply states: "The fastest way to the truth is a joke." Another Crab's Treasure, the second offering from indie Australian studio Aggro Crab, is full of truth and jokes – and something else, something rarer, too. Another Crab's Treasure is ostensibly a combat-oriented adventure game, in which you play a tiny hermit crab whose shell has been stolen. You must explore the depths of the ocean to find a way to retrieve it from the Loan Shark, so you can return the wee crab to his peaceful life in the tide pools on the shore.


Does AI Have a Subconscious?

WIRED

"There's been a lot of speculation recently about the possibility of AI consciousness or self-awareness. But I wonder: Does AI have a subconscious?" For philosophical guidance on encounters with technology, open a support ticket via email; or register and post a comment below. Dear Psychobabble, Sometime in the early 2000s, I came across an essay in which the author argued that no artificial consciousness will ever be believably human unless it can dream. I cannot remember who wrote it or where it was published, though I vividly recall where I was when I read it (the periodicals section of Barbara's Bookstore, Halsted Street, Chicago) and the general feel of that day (twilight, early spring).


"Riding a Racehorse Through a Field of Concepts": What It's Like to Write a Book With an A.I.

Slate

K Allado-McDowell had been working with artificial intelligence for years--they established the Artists and Machine Intelligence program at Google AI--when the pandemic prompted a new, more personal kind of engagement. During this period of isolation, they started a conversation with GPT-3, the latest iteration of the Generative Pre-trained Transformer language model released by OpenAI earlier this year. GPT-3 is, in short, a statistical language model drawing on a training corpus of 499 billion tokens (mostly Common Crawl data scraped from the internet, along with digitized books and Wikipedia) that takes a user-contributed text prompt and uses machine learning to predict what will come next. The results of Allado-McDowell's explorations--a multigenre collection of essays, poetry, memoir, and science fiction--were recently published in the U.K. as Pharmako-AI, the first book "co-authored" with GPT-3. By its very nature, the book forces us to ask who is responsible for which aspects of its authorship and to question how we imagine or conceptualize that nonhuman half.


How AI and Neuroscience can save our children's education, health and well being.

#artificialintelligence

AI can be our worst enemy or our best friend, but we do have a choice. Humans have a bias towards fear induced decisions, what do I mean by that? Our brains have evolved over millions of years, but have only been hit with technology in the past hundred years or so. Our brains are still geared to preservation, sexual reproduction and just plain survival. To paraphrase the words of the famous physicist Niels Bohr who was referring to quantum physics'If you are not shocked by the prospect of AI and its effect, on the human race you have not understood it.'


The meta-problem and the transfer of knowledge between theories of consciousness: a software engineer's take

Kvassay, Marcel

arXiv.org Artificial Intelligence

This contribution examines two radically different explanations of our phenomenal intuitions, one reductive and one strongly non-reductive, and identifies two germane ideas that could benefit many other theories of consciousness. Firstly, the ability of sophisticated agent architectures with a purely physical implementation to support certain functional forms of qualia or proto-qualia appears to entail the possibility of machine consciousness with qualia, not only for reductive theories but also for the nonreductive ones that regard consciousness as ubiquitous in Nature. Secondly, analysis of introspective psychological material seems to hint that, under the threshold of our ordinary waking awareness, there exist further'submerged' or'subliminal' layers of consciousness which constitute a hidden foundation and support and another source of our phenomenal intuitions. These'submerged' layers might help explain certain puzzling phenomena concerning subliminal perception, such as the apparently'unconscious' multisensory integration and learning of subliminal stimuli. As a researcher in intelligent technologies, I have long been interested in scholarly debates about consciousness.


AI is revolutionizing neuromarketing

#artificialintelligence

An unfortunate fact about humanity is that people lie. While this is a chronic issue for human relations, it's one that may be less of an issue for marketers of the future, thanks to non-human intervention. For most of marketing history, the best way to find out if consumers liked a proposed product was to ask them what they thought about it. But in focus groups especially, people tend to stretch the truth, undermining the value of the entire study. In recent years, AI has offered a huge boost to neuromarketing -- the science of reading consumers' minds to gauge their reactions to marketing stimuli.


AI is revolutionizing neuromarketing

#artificialintelligence

An unfortunate fact about humanity is that people lie. While this is a chronic issue for human relations, it's one that may be less of an issue for marketers of the future, thanks to non-human intervention. For most of marketing history, the best way to find out if consumers liked a proposed product was to ask them what they thought about it. But in focus groups especially, people tend to stretch the truth, undermining the value of the entire study. In recent years, AI has offered a huge boost to neuromarketing -- the science of reading consumers' minds to gauge their reactions to marketing stimuli.