How can we effectively train deep neural networks on relatively small datasets while improving generalization?

Research into whether drugs like ayahuasca can mitigate the effects of traumatic brain injury is in its infancy. Pro athletes like the Buffalo Bills' Jordan Poyer are forging ahead anyway. Roam the wide-open halls and cavernous showrooms of the Colorado Convention Center during Psychedelic Science, the world's largest psychedelics conference, and you'll see exhibitors hawking everything from mushroom jewelry, to chewable gummies containing extracts of the psychoactive succulent plant kanna, to broad flat-brim baseball caps emblazoned with "MDMA" and "IBOGA." Booths publicize organizations such as the Ketamine Taskforce and the Psychedelic Parenthood Community, and even, a live-action feature film looking to attract investors. It's a motley, multifarious symposium where indigenous-plant-medicine healers mingle with lanyard-clad pharma-bros, legendary underground LSD chemists, and workaday stoners tottering around in massive red and white toadstool hats that make them look like that cute little mushroom guy from . And yet, oddest among such oddities may be the sight of enormously burly NFL tough guys talking candidly about their feelings.

Whether or not we grow new brain cells as adults has been the subject of an ongoing and often contentious debate. Now, evidence suggests that we can. This could help answer one of neuroscience's most controversial questions and has sparked some speculation that the process could be exploited to treat conditions like depression and Alzheimer's disease. New neurons form via a process called neurogenesis in children, as well as in adult mice and macaques. This involves stem cells repeatedly giving rise to so-called progenitor cells that proliferate to form immature neurons that later become fully developed. Prior studies on human adults have identified stem cells and immature neurons in the hippocampus.

Breakthroughs, discoveries, and DIY tips sent every weekday. Your body is constantly generating new cells. In your digestive tract, the colon's lining turns over every five to seven days. Your red blood cells replace themselves every few weeks, skin cells about once a month. But certain organs are a big exception.

Continual locomotion learning faces four challenges: incomprehensibility, sample inefficiency, lack of knowledge exploitation, and catastrophic forgetting. Thus, this work introduces Growable Online Locomotion Learning Under Multicondition (GOLLUM), which exploits the interpretability feature to address the aforementioned challenges. GOLLUM has two dimensions of interpretability: layer-wise interpretability for neural control function encoding and column-wise interpretability for robot skill encoding. With this interpretable control structure, GOLLUM utilizes neurogenesis to unsupervisely increment columns (ring-like networks); each column is trained separately to encode and maintain a specific primary robot skill. GOLLUM also transfers the parameters to new skills and supplements the learned combination of acquired skills through another neural mapping layer added (layer-wise) with online supplementary learning. On a physical hexapod robot, GOLLUM successfully acquired multiple locomotion skills (e.g., walking, slope climbing, and bouncing) autonomously and continuously within an hour using a simple reward function. Furthermore, it demonstrated the capability of combining previous learned skills to facilitate the learning process of new skills while preventing catastrophic forgetting. Compared to state-of-the-art locomotion learning approaches, GOLLUM is the only approach that addresses the four challenges above mentioned without human intervention. It also emphasizes the potential exploitation of interpretability to achieve autonomous lifelong learning machines.

Artificial Intelligence (AI) has achieved new levels of performance and spread in public usage with the rise of deep neural networks (DNNs). Initially inspired by human neurons and their connections, NNs have become the foundation of AI models for many advanced architectures. However, some of the most integral processes in the human brain, particularly neurogenesis and neuroplasticity in addition to the more spread neuroapoptosis have largely been ignored in DNN architecture design. Instead, contemporary AI development predominantly focuses on constructing advanced frameworks, such as large language models, which retain a static structure of neural connections during training and inference. In this light, we explore how neurogenesis, neuroapoptosis, and neuroplasticity can inspire future AI advances. Specifically, we examine analogous activities in artificial NNs, introducing the concepts of ``dropin'' for neurogenesis and revisiting ``dropout'' and structural pruning for neuroapoptosis. We additionally suggest neuroplasticity combining the two for future large NNs in ``life-long learning'' settings following the biological inspiration. We conclude by advocating for greater research efforts in this interdisciplinary domain and identifying promising directions for future exploration.

Continual learning (CL) refers to an agent's capability to learn from a continuous stream of data and transfer knowledge without forgetting old information. One crucial aspect of CL is forward transfer, i.e., improved and faster learning on a new task by leveraging information from prior knowledge. While this ability comes naturally to biological brains, it poses a significant challenge for artificial intelligence (AI). Here, we suggest that environmental enrichment (EE) can be used as a biological model for studying forward transfer, inspiring human-like AI development. EE refers to animal studies that enhance cognitive, social, motor, and sensory stimulation and is a model for what, in humans, is referred to as 'cognitive reserve'. Enriched animals show significant improvement in learning speed and performance on new tasks, typically exhibiting forward transfer. We explore anatomical, molecular, and neuronal changes post-EE and discuss how artificial neural networks (ANNs) can be used to predict neural computation changes after enriched experiences. Finally, we provide a synergistic way of combining neuroscience and AI research that paves the path toward developing AI capable of rapid and efficient new task learning.

Deep Neural Networks (DNNs) are built using artificial neural networks. They are part of machine learning methods that are capable of learning from data that have been used in a wide range of applications. DNNs are mainly handcrafted and they usually contain numerous layers. Research frontier has emerged that concerns automated construction of DNNs via evolutionary algorithms. This paper emphasizes the importance of what we call two-dimensional brain evolution and how it can inspire two dimensional DNN evolutionary modeling. We also highlight the connection between the dropout method which is widely-used in regularizing DNNs and neurogenesis of the brain, and how these concepts could benefit DNNs evolution.The paper concludes with several recommendations for enhancing the automatic construction of DNNs.

Abstract: New neurons are continuously generated in the subgranular zone of the dentate gyrus throughout adulthood. These new neurons gradually integrate into hippocampal circuits, forming new naïve synapses. Viewed from this perspective, these new neurons may represent a significant source of'wiring' noise in hippocampal networks. In machine learning, such noise injection is commonly used as a regularization technique. Regularization techniques help prevent overfitting training data, and allow models to generalize learning to new, unseen data.

A new study from the Institute of Psychiatry, Psychology and Neuroscience (IoPPN) at King's College London has established that Intermittent Fasting (IF) is an effective means of improving long term memory retention and generating new adult hippocampal neurons in mice, in what the researchers hope has the potential to slow the advance of cognitive decline in older people. The study, published today in Molecular Psychiatry, found that a calorie restricted diet via every other day fasting was an effective means of promoting Klotho gene expression in mice. Klotho, which is often referred to as the "longevity gene" has now been shown in this study to play a central role in the production of hippocampal adult-born new neurons or neurogenesis. Adult-born hippocampal neurons are important for memory formation and their production declines with age, explaining in part cognitive decline in older people. The researchers split female mice into three groups; a control group that received a standard diet of daily feeding, a daily Calorie Restricted (CR) diet, and Intermittent Fasting (IF) in which the mice were fed every other day.