Translations:Transfer Learning/11/en: Difference between revisions
(Importing a new version from external source) Tag: Manual revert |
(Importing a new version from external source) Tag: Manual revert |
||
| Line 5: | Line 5: | ||
| '''Feature extraction''' || Freeze all pretrained layers; train only a new output head || Very small target dataset; source and target are closely related | | '''Feature extraction''' || Freeze all pretrained layers; train only a new output head || Very small target dataset; source and target are closely related | ||
|- | |- | ||
| ''' | | '''{{Term|fine-tuning}} (full)''' || Unfreeze all layers and train end-to-end with a small {{Term|learning rate}} || Moderate target dataset; source and target differ meaningfully | ||
|- | |- | ||
| '''Gradual unfreezing''' || Progressively unfreeze layers from top to bottom over training || Balances stability of lower features with adaptation of higher ones | | '''Gradual unfreezing''' || Progressively unfreeze layers from top to bottom over training || Balances stability of lower features with adaptation of higher ones | ||
|} | |} | ||
Latest revision as of 23:34, 27 April 2026
| Strategy | Description | When to use |
|---|---|---|
| Feature extraction | Freeze all pretrained layers; train only a new output head | Very small target dataset; source and target are closely related |
| fine-tuning (full) | Unfreeze all layers and train end-to-end with a small learning rate | Moderate target dataset; source and target differ meaningfully |
| Gradual unfreezing | Progressively unfreeze layers from top to bottom over training | Balances stability of lower features with adaptation of higher ones |