Translations:Transfer Learning/11/en

    From Marovi AI
    Strategy Description When to use
    Feature extraction Freeze all pretrained layers; train only a new output head Very small target dataset; source and target are closely related
    Fine-tuning (full) Unfreeze all layers and train end-to-end with a small learning rate Moderate target dataset; source and target differ meaningfully
    Gradual unfreezing Progressively unfreeze layers from top to bottom over training Balances stability of lower features with adaptation of higher ones