cognitive pattern
The Other Mind: How Language Models Exhibit Human Temporal Cognition
Li, Lingyu, Yao, Yang, Wang, Yixu, Li, Chubo, Teng, Yan, Wang, Yingchun
As Large Language Models (LLMs) continue to advance, they exhibit certain cognitive patterns similar to those of humans that are not directly specified in training data. This study investigates this phenomenon by focusing on temporal cognition in LLMs. Leveraging the similarity judgment task, we find that larger models spontaneously establish a subjective temporal reference point and adhere to the Weber-Fechner law, whereby the perceived distance logarithmically compresses as years recede from this reference point. To uncover the mechanisms behind this behavior, we conducted multiple analyses across neuronal, representational, and informational levels. We first identify a set of temporal-preferential neurons and find that this group exhibits minimal activation at the subjective reference point and implements a logarithmic coding scheme convergently found in biological systems. Probing representations of years reveals a hierarchical construction process, where years evolve from basic numerical values in shallow layers to abstract temporal orientation in deep layers. Finally, using pre-trained embedding models, we found that the training corpus itself possesses an inherent, non-linear temporal structure, which provides the raw material for the model's internal construction. In discussion, we propose an experientialist perspective for understanding these findings, where the LLMs' cognition is viewed as a subjective construction of the external world by its internal representational system. This nuanced perspective implies the potential emergence of alien cognitive frameworks that humans cannot intuitively predict, pointing toward a direction for AI alignment that focuses on guiding internal constructions. Our code is available at https://TheOtherMind.github.io.
- Asia > China > Shanghai > Shanghai (0.04)
- North America > United States > Illinois > Cook County > Chicago (0.04)
- Europe > United Kingdom > England > Oxfordshire > Oxford (0.04)
- (3 more...)
- Research Report > New Finding (1.00)
- Research Report > Experimental Study (0.93)
Inducing Individual Students' Learning Strategies through Homomorphic POMDPs
Gao, Huifan, Zeng, Yifeng, Pan, Yinghui
Optimizing students' learning strategies is a crucial component in intelligent tutoring systems. Previous research has demonstrated the effectiveness of devising personalized learning strategies for students by modelling their learning processes through partially observable Markov decision process (POMDP). However, the research holds the assumption that the student population adheres to a uniform cognitive pattern. While this assumption simplifies the POMDP modelling process, it evidently deviates from a real-world scenario, thus reducing the precision of inducing individual students' learning strategies. In this article, we propose the homomorphic POMDP (H-POMDP) model to accommodate multiple cognitive patterns and present the parameter learning approach to automatically construct the H-POMDP model. Based on the H-POMDP model, we are able to represent different cognitive patterns from the data and induce more personalized learning strategies for individual students. We conduct experiments to show that, in comparison to the general POMDP approach, the H-POMDP model demonstrates better precision when modelling mixed data from multiple cognitive patterns. Moreover, the learning strategies derived from H-POMDPs exhibit better personalization in the performance evaluation.
- Asia > China > Guangdong Province > Shenzhen (0.04)
- Asia > China > Fujian Province > Xiamen (0.04)
- Oceania > New Zealand (0.04)
Assessing Argumentation Using Machine Learning and Cognitive Diagnostic Modeling - Research in Science Education
In this study, we developed machine learning algorithms to automatically score students' written arguments and then applied the cognitive diagnostic modeling (CDM) approach to examine students' cognitive patterns of scientific argumentation. We abstracted three types of skills (i.e., attributes) critical for successful argumentation practice: making claims, using evidence, and providing warrants. We developed 19 constructed response items, with each item requiring multiple cognitive skills. We collected responses from 932 students in Grades 5 to 8 and developed machine learning algorithmic models to automatically score their responses. We then applied CDM to analyze their cognitive patterns.
#Open #IoT with #Blockchain #AI and #BigData Paradigm Interactions
There will be many people who will say it does exist and has working technologies, hardware and software. It is an interesting error in thinking to focus on closed system devices/products as to what Ubiquity (IoT3) is. Devices are used to get across the point of various types of connections and networks being accessed. But more importantly in a full implementation of the concept of Ubiquity (often described as the IoT) devices may not even be owned anymore. The ownership of devices ceases to be important if you can own your digital identity, can verify it and establish your own ecosystem of assets in Blockchain.
#Open #IoT with #Blockchain #AI and #BigData – Paradigm Interactions
There will be many people who will say it does exist and has working technologies, hardware and software. It is an interesting error in thinking to focus on closed system devices/products as to what Ubiquity (IoT3) is. Devices are used to get across the point of various types of connections and networks being accessed. But more importantly in a full implementation of the concept of Ubiquity (often described as the IoT) devices may not even be owned anymore. The ownership of devices ceases to be important if you can own your digital identity, can verify it and establish your own ecosystem of assets in Blockchain.
#Open #IoT with #Blockchain #AI and #BigData Total Visits 11234 Paradigm Interactions
There will be many people who will say it does exist and has working technologies, hardware and software. It is an interesting error in thinking to focus on closed system devices/products as to what Ubiquity (IoT3) is. Devices are used to get across the point of various types of connections and networks being accessed. But more importantly in a full implementation of the concept of Ubiquity (often described as the IoT) devices may not even be owned anymore. The ownership of devices ceases to be important if you can own your digital identity, can verify it and establish your own ecosystem of assets in Blockchain.
#Open #IoT with #Blockchain #AI and #BigData Total Visits 2622 Paradigm Interactions
There will be many people who will say it does exist and has working technologies, hardware and software. It is an interesting error in thinking to focus on closed system devices/products as to what Ubiquity (IoT) is. Devices are used to get across the point of various types of connections and networks being accessed. But more importantly in a full implementation of the concept of Ubiquity (often described as the IoT) devices may not even be owned anymore. The ownership of devices ceases to be important if you can own your digital identity, can verify it and establish your own ecosystem of assets in Blockchain.