computational theory
A Computational Theory and Semi-Supervised Algorithm for Clustering
A computational theory for clustering and a semi-supervised clustering algorithm is presented. Clustering is defined to be the obtainment of groupings of data such that each group contains no anomalies with respect to a chosen grouping principle and measure; all other examples are considered to be fringe points, isolated anomalies, anomalous clusters or unknown clusters. More precisely, after appropriate modelling under the assumption of uniform random distribution, any example whose expectation of occurrence is <1 with respect to a group is considered an anomaly; otherwise it is assigned a membership of that group. Thus, clustering is conceived as the dual of anomaly detection. The representation of data is taken to be the Euclidean distance of a point to a cluster median. This is due to the robustness properties of the median to outliers, its approximate location of centrality and so that decision boundaries are general purpose. The kernel of the clustering method is Mohammad's anomaly detection algorithm, resulting in a parameter-free, fast, and efficient clustering algorithm. Acknowledging that clustering is an interactive and iterative process, the algorithm relies on a small fraction of known relationships between examples. These relationships serve as seeds to define the user's objectives and guide the clustering process. The algorithm then expands the clusters accordingly, leaving the remaining examples for exploration and subsequent iterations. Results are presented on synthetic and realworld data sets, demonstrating the advantages over the most widely used clustering methods.
Adaptive Stimulus Representations: A Computational Theory of Hippocampal-Region Function
We present a theory of cortico-hippocampal interaction in discrimination learning. The hippocampal region is presumed to form new stimulus representations which facilitate learning by enhancing the discriminability of predictive stimuli and compressing stimulus-stimulus redundancies. The cortical and cerebellar regions, which are the sites of long-term memory. It also makes several novel predictions which remain to be investigated empirically. The theory implies that the hippocampal region is involved in even the simplest learning tasks; although hippocampal-Iesioned animals may be able to use other strategies to learn these tasks.
Trends in Analog and Neural Computation – MetaDevo
Cognitive Science and AI typically subscribe to computationalism--the mind is a form of computation in the brain (or the overall nervous system including the brain). In the 1940s, explaining cognition as the brain computing was new, and started catching on in what would become computer science and AI…and eventually to some degree neuroscience. But many were modeling the brain using what you could call analog math.1Piccinini, And there were actual analog computers, many of which were used by the U.S. military starting in World War 2. Nowadays, most people use digital computers for research and AI work…and pretty much everything. But what happened to the non-digital theories, and why aren't there analog computers any more to experiment on those?
Visual Probing: Cognitive Framework for Explaining Self-Supervised Image Representations
Oleszkiewicz, Witold, Basaj, Dominika, Sieradzki, Igor, Górszczak, Michał, Rychalska, Barbara, Lewandowska, Koryna, Trzciński, Tomasz, Zieliński, Bartosz
Recently introduced self-supervised methods for image representation learning provide on par or superior results to their fully supervised competitors, yet the corresponding efforts to explain the self-supervised approaches lag behind. Motivated by this observation, we introduce a novel visual probing framework for explaining the self-supervised models by leveraging probing tasks employed previously in natural language processing. The probing tasks require knowledge about semantic relationships between image parts. Hence, we propose a systematic approach to obtain analogs of natural language in vision, such as visual words, context, and taxonomy. Our proposal is grounded in Marr's computational theory of vision and concerns features like textures, shapes, and lines. We show the effectiveness and applicability of those analogs in the context of explaining self-supervised representations. Our key findings emphasize that relations between language and vision can serve as an effective yet intuitive tool for discovering how machine learning models work, independently of data modality. Our work opens a plethora of research pathways towards more explainable and transparent AI.
A New Direction in AI: Toward a Computational Theory of Perceptions
Fast-forward (FF) was the most successful automatic planner in the Fifth International Conference on Artificial Intelligence Planning and Scheduling (AIPS '00) planning systems competition. Like the well-known hsp system, FF relies on forward search in the state space, guided by a heuristic that estimates goal distances by ignoring delete lists. It differs from HSP in a number of important details. This article describes the algorithmic techniques used in FF in comparison to hsp and evaluates their benefits in terms of run-time and solution-length behavior. Humans have a remarkable capability to perform a wide variety of physical and mental tasks without any measurements and any computations.
Toward a Computational Theory of Evidence-Based Reasoning for Instructable Cognitive Agents
Tecuci, Gheorghe, Marcu, Dorin, Boicu, Mihai, Meckl, Steven, Uttamsingh, Chirag
Evidence-based reasoning is at the core of ma ny problem - solving and decision-making tasks in a wide variety of domains. Generalizing from the research and development of cognitive agents in several such domains, this paper presents progress toward a computational theory for the development of instructable cognitive agents for evide nce-based reasoning tasks. The paper also illustrates the application of this theory to the development of four prototype cognitive agents in domains that are critical to the government and the public sector . Two agents function as cognitive assistants, one in intelligence analysis, and the other in science education . The other two agents operate autonomously, one in cybersecurity and the other in intelligence, surveillance, and reconnaissance. The paper concludes with the directions of future research on th e proposed computational theory.
You Won't Survive a Merger with AI - Issue 76: Language - Nautilus
The idea that humans should merge with AI is very much in the air these days. It is offered both as a way for humans to avoid being outmoded by AI in the workplace, and as a path to superintelligence and immortality. For instance, Elon Musk recently commented that humans can escape being outmoded by AI by "having some sort of merger of biological intelligence and machine intelligence."1 To this end, he's founded a company, Neuralink. One of its first aims is to develop "neural lace," an injectable mesh that connects the brain directly to computers. Neural lace and other AI-based enhancements are supposed to allow data from your brain to travel wirelessly to one's digital devices or to the cloud, where massive computing power is available.
Social AI might not kill us, but it will make us excruciatingly boring
Are you just a computer made of meat? Are all your thoughts, feelings and experiences nothing more than circuits made from neurons in your head? If you're like a lot of people, your answer to this question will be a definitive "No!" From science to philosophy, there are lots of good reasons to hold that human beings are more than just computing machines. Unfortunately, many of the technologists bringing versions of artificial intelligence to the market are already sure they know that we are. Suddenly we might be leaving our grandmas and maybe even our kids with emotional robots because, oh well, everybody's doing it. For them people are, indeed, just biological computers.
How can deep learning advance computational modeling of sensory information processing?
Thompson, Jessica A. F., Bengio, Yoshua, Formisano, Elia, Schönwiesner, Marc
Deep learning, computational neuroscience, and cognitive science have overlapping goals related to understanding intelligence such that perception and behaviour can be simulated in computational systems. In neuroimaging, machine learning methods have been used to test computational models of sensory information processing. Recently, these model comparison techniques have been used to evaluate deep neural networks (DNNs) as models of sensory information processing. However, the interpretation of such model evaluations is muddied by imprecise statistical conclusions. Here, we make explicit the types of conclusions that can be drawn from these existing model comparison techniques and how these conclusions change when the model in question is a DNN. We discuss how DNNs are amenable to new model comparison techniques that allow for stronger conclusions to be made about the computational mechanisms underlying sensory information processing.