User Tools

Site Tools


Sidebar

深度学习

应用领域:

  • 计算机视觉
  • 自然语言处理
  • 语音识别

相关方法:

  • 增量学习
  • 强化学习
  • 迁移学习
deep_learning:incremental_learning

This is an old revision of the document!


Incremental Learning

Introduction

Incremental Learning(IL) is also referred to as: Continual Learning(CL), Life Long Learning(LLL), Online Learning(OL), Never Ending Learning(NEL).

Incremental learning aims to develop artificially intelligent systems that can continuously learn to address new tasks from new data while preserving knowledge learned from previously learned tasks.

Key Challenge

Catastrophic Forgetting(CF): Learning multiple tasks in sequence, however, remains a substantial challenge for deep learning. When trained on a new task, standard neural networks forget most of the information related to previously learned tasks, a phenomenon referred to as “catastrophic forgetting”1).

Resources

Course

Papers

1)
Three scenarios for continual learning
deep_learning/incremental_learning.1627811109.txt.gz · Last modified: 2021/08/01 17:45 by jordan