Incremental Learning(IL) is also referred to as: Continual Learning(CL), Life Long Learning(LLL), Online Learning(OL), Never Ending Learning(NEL).

Incremental learning aims to develop artificially intelligent systems that can continuously learn to address new tasks from new data while preserving knowledge learned from previously learned tasks.¹⁾

Catastrophic Forgetting(CF): Learning multiple tasks in sequence, however, remains a substantial challenge for deep learning. When trained on a new task, standard neural networks forget most of the information related to previously learned tasks, a phenomenon referred to as “catastrophic forgetting”²⁾.

There are 3 scenarios on Incremental Learning³⁾, including:

• Task Incremental Learning
• Domain Incremental Learning
• Class Incremental Learning

Catastrophic Forgetting by Hung-yi Lee

Mitigating Catastrophic Forgetting by Hung-yi Lee

Awesome Incremental Learning Papers

Incremental Learning Papers