Goto

Collaborating Authors

 update function


Flexible inference for animal learning rules using neural networks

Neural Information Processing Systems

Understanding how animals learn is a central challenge in neuroscience, with growing relevance to the development of animal-or human-aligned artificial intelligence. However, existing approaches tend to assume fixed parametric forms for the learning rule (e.g., Q-learning, policy gradient), which may not accurately describe the complex forms of learning employed by animals in realistic settings. Here we address this gap by developing a framework to infer learning rules directly from behavioral data collected during de novo task learning. We assume that animals follow a decision policy parameterized by a generalized linear model (GLM), and we model their learning rule--the mapping from task covariates to per-trial weight updates--using a deep neural network (DNN). This formulation allows flexible, data-driven inference of learning rules while maintaining an interpretable form of the decision policy itself.


A graphon-signal analysis of graph neural networks

Neural Information Processing Systems

We present an approach for analyzing message passing graph neural networks (MPNNs) based on an extension of graphon analysis to a so called graphon-signal analysis. AMPNN is a function that takes a graph and a signal on the graph (a graph-signal) and returns some value. Since the input space of MPNNs is non-Euclidean, i.e., graphs can be of any size and topology, properties such as generalization are less well understood for MPNNs than for Euclidean neural networks. We claim that one important missing ingredient in past work is a meaningful notion of graph-signal similarity measure, that endows the space of inputs to MPNNs with a regular structure. We present such a similarity measure, called the graphon-signal cut distance, which makes the space of all graph-signals a dense subset of a compact metric space - the graphon-signal space.


Appendix

Neural Information Processing Systems

In this section, we provide background information in probability theory, and focus on random processes and concentration of measure inequalities.




a57ecd54d4df7d999bd9c5e3b973ec75-Supplemental.pdf

Neural Information Processing Systems

Wecanseethis as the slope of the update function changes (middle row of Figure 1), these green lines correspond tothelocations givenbythearrowsinthetoprow.





Object-CentricLearningwithSlotAttention

Neural Information Processing Systems

Learning object-centric representations of complex scenes is a promising step towards enabling efficient abstract reasoning from low-levelperceptual features. Yet, most deep learning approaches learn distributed representations that do not capture the compositional properties of natural scenes.