ContinualAI Releases Avalanche: An End-to-End Library for Continual Learning

Albert Einstein once said that "wisdom is not a product of schooling, but the lifelong attempt to acquire it." Centuries of human progress have been built on our brains' ability to continually acquire, fine-tune and transfer knowledge and skills. Such continual learning however remains a long-standing challenge in machine learning (ML), where the ongoing acquisition of incrementally available information from non-stationary data often leads to catastrophic forgetting problems. Gradient-based deep architectures have spurred the development of continual learning in recent years, but continual learning algorithms are often designed and implemented from scratch with different assumptions, settings, and benchmarks, making them difficult to compare, port, or reproduce. Now, a research and development team from ContinualAI with researchers from KU Leuven, ByteDance AI Lab, University of California, New York University and other institutions has proposed Avalanche, an end-to-end library for continual learning based on PyTorch.