知识库｜湖南麓川信息科技有限公司

--- deep_learning:incremental_learning [2021/08/05 22:47]
jordan [Key Challenge]
+++ deep_learning:incremental_learning [2023/03/08 16:04] (current)
xujianglong ↷ Page moved from 内部资料:deep_learning:incremental_learning to deep_learning:incremental_learning
@@ Line 18: / Line 18: @@
   * Domain Incremental Learning
   * Class Incremental Learning
+===== Methods =====
+All methods of incremental learning can be concluded into 4 categories(([[https://arxiv.org/abs/1904.07734v1|Three scenarios for continual learning]])).
+  * Task specific components(sub-network per task): **XDG**(Context-dependent Gating)
+  * regularized optimization(differently regularizing parameters): **[[deep_learning:incremental_learning:EWC]]**(Elastic Weight Consolidation), **SI**(Synaptic Intelligence)
+  * Modifying Training Data(pseudo-data, generate samples): **[[deep_learning:incremental_learning:LwF]]**(Learning without Forgetting), **DGR**(Deep Generative Replay)
+  * Using Exemplars(store data from previous tasks): **[[deep_learning:incremental_learning:iCaRL]]**
 ===== Resources =====