planck
Identifying Quantum Structure in AI Language: Evidence for Evolutionary Convergence of Human and Artificial Cognition
Aerts, Diederik, Arguëlles, Jonito Aerts, Beltran, Lester, Geriente, Suzette, Leporini, Roberto, de Bianchi, Massimiliano Sassoli, Sozzo, Sandro
We present the results of cognitive tests on conceptual combinations, performed using specific Large Language Models (LLMs) as test subjects. In the first test, performed with ChatGPT and Gemini, we show that Bell's inequalities are significantly violated, which indicates the presence of 'quantum entanglement' in the tested concepts. In the second test, also performed using ChatGPT and Gemini, we instead identify the presence of 'Bose-Einstein statistics', rather than the intuitively expected 'Maxwell-Boltzmann statistics', in the distribution of the words contained in large-size texts. Interestingly, these findings mirror the results previously obtained in both cognitive tests with human participants and information retrieval tests on large corpora. Taken together, they point to the 'systematic emergence of quantum structures in conceptual-linguistic domains', regardless of whether the cognitive agent is human or artificial. Although LLMs are classified as neural networks for historical reasons, we believe that a more essential form of knowledge organization takes place in the distributive semantic structure of vector spaces built on top of the neural network. It is this meaning-bearing structure that lends itself to a phenomenon of evolutionary convergence between human cognition and language, slowly established through biological evolution, and LLM cognition and language, emerging much more rapidly as a result of self-learning and training. We analyze various aspects and examples that contain evidence supporting the above hypothesis. We also advance a unifying framework that explains the pervasive quantum organization of meaning that we identify.
- Europe > United Kingdom > England > Cambridgeshire > Cambridge (0.04)
- North America > United States > New York (0.04)
- North America > United States > Illinois > Cook County > Chicago (0.04)
- (5 more...)
- Research Report > Experimental Study (0.67)
- Research Report > New Finding (0.46)
- Health & Medicine (0.47)
- Energy (0.45)
Meaning at the Planck scale? Contextualized word embeddings for doing history, philosophy, and sociology of science
This paper explores the potential of contextualized word embeddings (CWEs) as a new tool in the history, philosophy, and sociology of science (HPSS) for studying contextual and evolving meanings of scientific concepts. Using the term "Planck" as a test case, I evaluate five BERT-based models with varying degrees of domain-specific pretraining, including my custom model Astro-HEP-BERT, trained on the Astro-HEP Corpus, a dataset containing 21.84 million paragraphs from 600,000 articles in astrophysics and high-energy physics. For this analysis, I compiled two labeled datasets: (1) the Astro-HEP-Planck Corpus, consisting of 2,900 labeled occurrences of "Planck" sampled from 1,500 paragraphs in the Astro-HEP Corpus, and (2) a physics-related Wikipedia dataset comprising 1,186 labeled occurrences of "Planck" across 885 paragraphs. Results demonstrate that the domain-adapted models outperform the general-purpose ones in disambiguating the target term, predicting its known meanings, and generating high-quality sense clusters, as measured by a novel purity indicator I developed. Additionally, this approach reveals semantic shifts in the target term over three decades in the unlabeled Astro-HEP Corpus, highlighting the emergence of the Planck space mission as a dominant sense. The study underscores the importance of domain-specific pretraining for analyzing scientific language and demonstrates the cost-effectiveness of adapting pretrained models for HPSS research. By offering a scalable and transferable method for modeling the meanings of scientific concepts, CWEs open up new avenues for investigating the socio-historical dynamics of scientific discourses.
- North America > United States > Illinois > Cook County > Chicago (0.04)
- Europe > United Kingdom > England > Oxfordshire > Oxford (0.04)
- Europe > United Kingdom > England > Cambridgeshire > Cambridge (0.04)
- (2 more...)
A Planck Radiation and Quantization Scheme for Human Cognition and Language
Aerts, Diederik, Beltran, Lester
Recently, we have shown that quantum statistics, and more specifically the Bose-Einstein statistics, is also prominently and convincingly present in human cognition, and more specifically in the structure of human language (Aerts & Beltran, 2020, 2022). The presence of the Bose-Einstein statistics in quantum mechanics is associated with the'identity' and'indistinguishability' of quantum particles, and is probably one of the most still poorly understood aspects of quantum reality (French & Redhead, 1988; Saunders, 2003; Muller & Seevinck, 2009; Krause, 2010; Dieks & Lubberdink, 2020). Although there are connections to entanglement, and in linear quantum optics there is now effective experimental use of the'indistinguishability' of photons to fabricate qubits, and thus'indistinguishability' is considered a'resource' for quantum computing, it remains one of the most mysterious quantum properties, also structurally different from entanglement (Franco & Compagno, 2018). The original interest of one of us in identifying in human cognition and language an equivalent of this situation of'indistinguishability' in quantum mechanics, leading to the Bose-Einstein statistics, was motivated by working on a specific interpretation of quantum mechanics, called the'conceptuality interpretation' (Aerts, 2009b). Thus, this original motivation was aimed more at increasing the understanding and explanation of what'identical' and'indistinguishable' quantum particles really are, rather than intended to introduce an additional rationale for research in quantum cognition. With a focus still primarily on this original motivation, work continued on the identification of a Bose-Einstein-like statistics by one of us, with a PhD student and collaborator, and more and better experimental evidence was collected for the superiority of Bose-Einstein statistics in modeling specific situations in human language as compared to Maxwell-Boltzmann statistics (Aerts, Sozzo & Veloz, 2015b).
- Energy > Oil & Gas (0.46)
- Leisure & Entertainment (0.45)
Are Words the Quanta of Human Language? Extending the Domain of Quantum Cognition
Aerts, Diederik, Beltran, Lester
In previous research, we showed that 'texts that tell a story' exhibit a statistical structure that is not Maxwell-Boltzmann but Bose-Einstein. Our explanation is that this is due to the presence of 'indistinguishability' in human language as a result of the same words in different parts of the story being indistinguishable from one another. In the current article, we set out to provide an explanation for this Bose-Einstein statistics. We show that it is the presence of 'meaning' in 'stories' that gives rise to the lack of independence characteristic of Bose-Einstein, and provides conclusive evidence that 'words can be considered the quanta of human language', structurally similar to how 'photons are the quanta of light'. Using several studies on entanglement from our Brussels research group, we also show that it is also the presence of 'meaning' in texts that makes the von Neumann entropy of a total text smaller relative to the entropy of the words composing it. We explain how the new insights in this article fit in with the research domain called 'quantum cognition', where quantum probability models and quantum vector spaces are used in human cognition, and are also relevant to the use of quantum structures in information retrieval and natural language processing, and how they introduce 'quantization' and 'Bose-Einstein statistics' as relevant quantum effects there. Inspired by the conceptuality interpretation of quantum mechanics, and relying on the new insights, we put forward hypotheses about the nature of physical reality. In doing so, we note how this new type of decrease in entropy, and its explanation, may be important for the development of quantum thermodynamics. We likewise note how it can also give rise to an original explanatory picture of the nature of physical reality on the surface of planet Earth, in which human culture emerges as a reinforcing continuation of life.
- Europe > United Kingdom > England > Cambridgeshire > Cambridge (0.04)
- North America > United States > New York (0.04)
- North America > United States > Massachusetts > Suffolk County > Boston (0.04)
- (5 more...)