cognitive skill
Unraveling the cognitive patterns of Large Language Models through module communities
Bhandari, Kushal Raj, Chen, Pin-Yu, Gao, Jianxi
Large Language Models (LLMs) have reshaped our world with significant advancements in science, engineering, and society through applications ranging from scientific discoveries and medical diagnostics to Chatbots. Despite their ubiquity and utility, the underlying mechanisms of LLM remain concealed within billions of parameters and complex structures, making their inner architecture and cognitive processes challenging to comprehend. We address this gap by adopting approaches to understanding emerging cognition in biology and developing a network-based framework that links cognitive skills, LLM architectures, and datasets, ushering in a paradigm shift in foundation model analysis. The skill distribution in the module communities demonstrates that while LLMs do not strictly parallel the focalized specialization observed in specific biological systems, they exhibit unique communities of modules whose emergent skill patterns partially mirror the distributed yet interconnected cognitive organization seen in avian and small mammalian brains. Our numerical results highlight a key divergence from biological systems to LLMs, where skill acquisition benefits substantially from dynamic, cross-regional interactions and neural plasticity. By integrating cognitive science principles with machine learning, our framework provides new insights into LLM interpretability and suggests that effective fine-tuning strategies should leverage distributed learning dynamics rather than rigid modular interventions.
- Europe > United Kingdom > England > Oxfordshire > Oxford (0.28)
- North America > United States > Minnesota > Hennepin County > Minneapolis (0.14)
- North America > United States > California > San Francisco County > San Francisco (0.14)
- (9 more...)
- Health & Medicine > Therapeutic Area > Neurology (1.00)
- Education (1.00)
Examining the effects of music on cognitive skills of children in early childhood with the Pythagorean fuzzy set approach
Kirisci, Murat, Topac, Nihat, Bardak, Musa
There are many genetic and environmental factors that affect cognitive development. Music education can also be considered as one of the environmental factors. Some researchers emphasize that Music is an action that requires meta-cognitive functions such as mathematics and chess and supports spatial intelligence. The effect of Music on cognitive development in early childhood was examined using the Pythagorean Fuzzy Sets(PFS) method defined by Yager. This study created PFS based on experts' opinions, and an algorithm was given according to PFS. The algorithm's results supported the experts' data on the development of spatial-temporal skills in music education given in early childhood. The algorithm's ranking was done using the Expectation Score Function. The rankings obtained from the algorithm overlap with the experts' rankings.
- Europe > Middle East > Republic of Türkiye > Istanbul Province > Istanbul (0.06)
- Asia > Middle East > Republic of Türkiye > Istanbul Province > Istanbul (0.06)
- North America > United States (0.04)
- (3 more...)
- Leisure & Entertainment (1.00)
- Health & Medicine > Therapeutic Area > Psychiatry/Psychology (0.88)
- Education > Curriculum > Subject-Specific Education (0.71)
- Health & Medicine > Therapeutic Area > Neurology (0.66)
'Don't ask what AI can do for us, ask what it is doing to us': are ChatGPT and co harming human intelligence?
Imagine for a moment you are a child in 1941, sitting the common entrance exam for public schools with nothing but a pencil and paper. You read the following: "Write, for no more than a quarter of an hour, about a British author." Today, most of us wouldn't need 15 minutes to ponder such a question. We'd get the answer instantly by turning to AI tools such as Google Gemini, ChatGPT or Siri. Offloading cognitive effort to artificial intelligence has become second nature, but with mounting evidence that human intelligence is declining, some experts fear this impulse is driving the trend.
- Europe (0.30)
- North America > United States > Pennsylvania (0.15)
- Information Technology > Artificial Intelligence > Natural Language > Large Language Model (1.00)
- Information Technology > Artificial Intelligence > Natural Language > Chatbot (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Neural Networks > Deep Learning (1.00)
- Information Technology > Artificial Intelligence > Cognitive Science > Creativity & Intelligence (1.00)
Investigating Large Language Models in Diagnosing Students' Cognitive Skills in Math Problem-solving
Jin, Hyoungwook, Kim, Yoonsu, Jung, Dongyun, Kim, Seungju, Choi, Kiyoon, Son, Jinho, Kim, Juho
Mathematics learning entails mastery of both content knowledge and cognitive processing of knowing, applying, and reasoning with it. Automated math assessment primarily has focused on grading students' exhibition of content knowledge by finding textual evidence, such as specific numbers, formulas, and statements. Recent advancements in problem-solving, image recognition, and reasoning capabilities of large language models (LLMs) show promise for nuanced evaluation of students' cognitive skills. Diagnosing cognitive skills needs to infer students' thinking processes beyond textual evidence, which is an underexplored task in LLM-based automated assessment. In this work, we investigate how state-of-the-art LLMs diagnose students' cognitive skills in mathematics. We constructed MathCog, a novel benchmark dataset comprising 639 student responses to 110 expert-curated middle school math problems, each annotated with detailed teachers' diagnoses based on cognitive skill checklists. Using MathCog, we evaluated 16 closed and open LLMs of varying model sizes and vendors. Our evaluation reveals that even the state-of-the-art LLMs struggle with the task, all F1 scores below 0.5, and tend to exhibit strong false confidence for incorrect cases ($r_s=.617$). We also found that model size positively correlates with the diagnosis performance ($r_s=.771$). Finally, we discuss the implications of these findings, the overconfidence issue, and directions for improving automated cognitive skill diagnosis.
- South America > Argentina > Pampas > Buenos Aires F.D. > Buenos Aires (0.04)
- North America > United States > New Jersey > Mercer County > Princeton (0.04)
- Asia > South Korea > Seoul > Seoul (0.04)
- (2 more...)
- Education > Curriculum (0.93)
- Education > Educational Setting > K-12 Education (0.88)
Physical AI Agents: Integrating Cognitive Intelligence with Real-World Action
Vertical AI Agents are revolutionizing industries by delivering domain-specific intelligence and tailored solutions. However, many sectors, such as manufacturing, healthcare, and logistics, demand AI systems capable of extending their intelligence into the physical world, interacting directly with objects, environments, and dynamic conditions. This need has led to the emergence of Physical AI Agents--systems that integrate cognitive reasoning, powered by specialized LLMs, with precise physical actions to perform real-world tasks. This work introduces Physical AI Agents as an evolution of shared principles with Vertical AI Agents, tailored for physical interaction. We propose a modular architecture with three core blocks--perception, cognition, and actuation--offering a scalable framework for diverse industries. Additionally, we present the Physical Retrieval Augmented Generation (Ph-RAG) design pattern, which connects physical intelligence to industry-specific LLMs for real-time decision-making and reporting informed by physical context. Through case studies, we demonstrate how Physical AI Agents and the Ph-RAG framework are transforming industries like autonomous vehicles, warehouse robotics, healthcare, and manufacturing, offering businesses a pathway to integrate embodied AI for operational efficiency and innovation.
- Information Technology (1.00)
- Health & Medicine (1.00)
- Food & Agriculture > Agriculture (0.68)
- Energy > Oil & Gas > Midstream (0.48)
Intelligent men are less likely to suffer from erectile dysfunction, study finds
It might seem a little convenient coming from a group of highly educated scientists. But researchers now say that geeks make better romantic partners than any muscle-bound meathead. In a new study, scientists from Oakland University claim that intelligent men have better relationship outcomes and are less likely to be abusive towards their partners. And, in good news for nerds, the researchers even claim that smarter men are less likely to suffer from erectile dysfunction. The scientists tested the intelligence of men in heterosexual relationships and then surveyed them for a range of different positive or negative relationship traits.
- Health & Medicine > Therapeutic Area > Urology (0.72)
- Health & Medicine > Therapeutic Area > Nephrology (0.72)
How critically can an AI think? A framework for evaluating the quality of thinking of generative artificial intelligence
Zaphir, Luke, Lodge, Jason M., Lisec, Jacinta, McGrath, Dom, Khosravi, Hassan
Generative AI such as those with large language models have created opportunities for innovative assessment design practices. Due to recent technological developments, there is a need to know the limits and capabilities of generative AI in terms of simulating cognitive skills. Assessing student critical thinking skills has been a feature of assessment for time immemorial, but the demands of digital assessment create unique challenges for equity, academic integrity and assessment authorship. Educators need a framework for determining their assessments vulnerability to generative AI to inform assessment design practices. This paper presents a framework that explores the capabilities of the LLM ChatGPT4 application, which is the current industry benchmark. This paper presents the Mapping of questions, AI vulnerability testing, Grading, Evaluation (MAGE) framework to methodically critique their assessments within their own disciplinary contexts. This critique will provide specific and targeted indications of their questions vulnerabilities in terms of the critical thinking skills. This can go on to form the basis of assessment design for their tasks.
- North America > United States > California (0.04)
- Asia > Middle East > Jordan (0.04)
- Oceania > Australia > Queensland (0.04)
- (2 more...)
- Education > Curriculum > Subject-Specific Education (0.46)
- Information Technology > Security & Privacy (0.35)
- Information Technology > Artificial Intelligence > Natural Language > Large Language Model (1.00)
- Information Technology > Artificial Intelligence > Natural Language > Generation (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Neural Networks > Deep Learning > Generative AI (1.00)
Does getting even mild covid-19 affect our cognitive skills?
Do most of us have slightly diminished brainpower as a result of getting covid-19? That is the implication of the largest study on this so far, involving more than 100,000 people, but its findings raise more questions than they answer. A team in the UK invited 800,000 people in the country to take part in research on the cognitive effects of covid-19.
Being on your period doesn't affect your cognitive skills
Verbal and spatial skills, like word memorisation and navigation, remain consistent throughout a person's menstrual cycle, suggesting menstruation has little effect on these cognitive functions. Previous research has suggested that the menstrual cycle may affect cognition due to hormonal fluctuations. For instance, studies have shown brain regions critical for spatial processing and memory change in size as the concentration of certain hormones ebbs and flows.