Goto

Collaborating Authors

 Industry


Backpropagation for Energy-Efficient Neuromorphic Computing

Neural Information Processing Systems

Solving real world problems with embedded neural networks requires both training algorithms that achieve high performance and compatible hardware that runs in real time while remaining energy efficient. For the former, deep learning using backpropagation has recently achieved a string of successes across many domains and datasets. For the latter, neuromorphic chips that run spiking neural networks have recently achieved unprecedented energy efficiency. To bring these two advances together, we must first resolve the incompatibility between backpropagation, which uses continuous-output neurons and synaptic weights, and neuromorphic designs, which employ spiking neurons and discrete synapses. Our approach is to treat spikes and discrete synapses as continuous probabilities, which allows training the network using standard backpropagation. The trained network naturally maps to neuromorphic hardware by sampling the probabilities to create one or more networks, which are merged using ensemble averaging. To demonstrate, we trained a sparsely connected network that runs on the TrueNorth chip using the MNIST dataset. With a high performance network (ensemble of $64$), we achieve $99.42\%$ accuracy at $121 \mu$J per image, and with a high efficiency network (ensemble of $1$) we achieve $92.7\%$ accuracy at $0.408 \mu$J per image.


GAP Safe screening rules for sparse multi-task and multi-class models

Neural Information Processing Systems

High dimensional regression benefits from sparsity promoting regularizations. Screening rules leverage the known sparsity of the solution by ignoring some variables in the optimization, hence speeding up solvers. When the procedure is proven not to discard features wrongly the rules are said to be safe. In this paper we derive new safe rules for generalized linear models regularized with L1 and L1/L2 norms. The rules are based on duality gap computations and spherical safe regions whose diameters converge to zero. This allows to discard safely more variables, in particular for low regularization parameters. The GAP Safe rule can cope with any iterative solver and we illustrate its performance on coordinate descent for multi-task Lasso, binary and multinomial logistic regression, demonstrating significant speed ups on all tested datasets with respect to previous safe rules.


AAAI News

AI Magazine

Lunch with a Fellow, and the Volunteer high standard, and of special interest AAAI-16 Registration is now available Program, in addition to the Student to the AAAI community.


Research Priorities for Robust and Beneficial Artificial Intelligence

AI Magazine

Success in the quest for artificial intelligence has the potential to bring unprecedented benefits to humanity, and it is therefore worthwhile to investigate how to maximize these benefits while avoiding potential pitfalls. This article gives numerous examples (which should by no means be construed as an exhaustive list) of such worthwhile research aimed at ensuring that AI remains robust and beneficial.


Cognition as a Service: An Industry Perspective

AI Magazine

Recent advances in cognitive computing componentry combined with other factors are leading to commercially viable cognitive systems. From chips to smart phones to public and private clouds, industrial strength “cognition as a service” is beginning to appear at all scales in business and society. Furthermore, in the age of zettabytes on the way to yottabytes, the designers, engineers, and managers of future smart systems will depend on cognition as a service. Cognition as a service can help unlock the mysteries of big data and ultimately boost the creativity and productivity of professionals and their teams, the productive output of industries and organizations, as well as the GDP (gross domestic product) of regions and nations. In this and the next decade, cognition as a service will allow us to re-image work practices, augmenting and scaling expertise to transform professions, industries, and regions.


Cognitive Prosthetics for Fostering Learning: A View from the Learning Sciences

AI Magazine

This article is aimed at helping AI researchers and practitioners imagine roles intelligent technologies might play in the many different and varied ecosystems in which people learn. My observations are based on learning sciences research of the past several decades, the possibilities of new technologies of the past few years, and my experience as program officer for the National Science Foundation’s Cyberlearning and Future Learning Technologies program. My thesis is that new technologies have potential to transform possibilities for fostering learning in both formal and informal learning environments by making it possible and manageable for learners to engage in the kinds of project work that professionals engage in and learn important content, skills, practices, habits, and dispositions from those experiences. The expertise of AI researchers and practitioners is critical to that vision, but it will require teaming up with others — for example, technology imagineers, educators, and learning scientists.


Extending the Diagnostic Capabilities of Artificial Intelligence-Based Instructional Systems

AI Magazine

Active problem solving has been shown to be one of the most effective ways to acquire complex skills. Whether one is learning a programming language by implementing a computer program, or learning calculus by solving problems, context sensitive feedback and guidance are crucial to keeping problem solving efforts fruitful and efficient. This article reviews AI-based algorithms that can diagnose student difficulties during active problem solving and serve as the basis for providing context-sensitive and individualized guidance. The article also describes the crucial role sensor based estimates of cognitive resources such as working memory capacity and attention can play in enhancing the diagnostic capabilities of intelligent instructional systems.


Human-Centered Design of Wearable Neuroprostheses and Exoskeletons

AI Magazine

Human-centered design of wearable robots involves the development of innovative science and technologies that minimize the mismatch between humans’ and machines’ capabilities, leading to their intuitive integration and confluent interaction. Here, we summarize our human-centered approach to the design of closed-loop brain-machine interfaces (BMI) to powered prostheses and exoskeletons that allow people to act beyond their impaired or diminished physical or sensory-motor capabilities. The goal is to develop multifunctional human-machine interfaces with integrated diagnostic, assistive and therapeutic functions. Moreover, these complex human-machine systems should be effective, reliable, safe and engaging and support the patient in performing intended actions with minimal effort and errors with adequate interaction time. To illustrate our approach, we review an example of a user-in-the-loop, patient-centered, non-invasive BMI system to a powered exoskeleton for persons with paraplegia. We conclude with a summary of challenges to the translation of these complex human-machine systems to the end-user.


Control Strategies and Artificial Intelligence in Rehabilitation Robotics

AI Magazine

Rehabilitation robots physically support and guide a patient's limb during motor therapy, but require sophisticated control algorithms and artificial intelligence to do so. This article provides an overview of the state of the art in this area. It begins with the dominant paradigm of assistive control, from impedance-based cooperative controller through electromyography and intention estimation. It then covers challenge-based algorithms, which provide more difficult and complex tasks for the patient to perform through resistive control and error augmentation. Furthermore, it describes exercise adaptation algorithms that change the overall exercise intensity based on the patient's performance or physiological responses, as well as socially assistive robots that provide only verbal and visual guidance. The article concludes with a discussion of the current challenges in rehabilitation robot software: evaluating existing control strategies in a clinical setting as well as increasing the robot's autonomy using entirely new artificial intelligence techniques.


Cognitive Orthoses: Toward Human-Centered AI

AI Magazine

This introduction focuses on how human-centered computing (HCC) is changing the way that people think about information technology. The AI perspective views this HCC framework as embodying a systems view, in which human thought and action are linked and equally important in terms of analysis, design, and evaluation. This emerging technology provides a new research outlook for AI applications, with new research goals and agendas.