User Tools

Site Tools


deep_learning:incremental_learning

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
deep_learning:incremental_learning [2021/08/05 22:47]
jordan [Key Challenge]
deep_learning:incremental_learning [2023/03/08 16:04] (current)
xujianglong ↷ Page moved from 内部资料:deep_learning:incremental_learning to deep_learning:incremental_learning
Line 18: Line 18:
   * Domain Incremental Learning   * Domain Incremental Learning
   * Class Incremental Learning   * Class Incremental Learning
 +
 +===== Methods =====
 +
 +All methods of incremental learning can be concluded into 4 categories(([[https://arxiv.org/abs/1904.07734v1|Three scenarios for continual learning]])).
 +
 +  * Task specific components(sub-network per task): **XDG**(Context-dependent Gating)
 +  * regularized optimization(differently regularizing parameters): **[[deep_learning:incremental_learning:EWC]]**(Elastic Weight Consolidation), **SI**(Synaptic Intelligence)
 +  * Modifying Training Data(pseudo-data, generate samples): **[[deep_learning:incremental_learning:LwF]]**(Learning without Forgetting), **DGR**(Deep Generative Replay)
 +  * Using Exemplars(store data from previous tasks): **[[deep_learning:incremental_learning:iCaRL]]**
 ===== Resources ===== ===== Resources =====
  
deep_learning/incremental_learning.1628174870.txt.gz · Last modified: 2021/08/05 22:47 by jordan