Translations:Batch Normalization/26/en

    From Marovi AI
    Method Normalizes over Use case
    Batch Norm Batch and spatial dims, per channel CNNs with large batches
    Layer Norm All channels and spatial dims, per sample Transformers, RNNs, small batches
    Instance Norm Spatial dims only, per sample per channel Style transfer, image generation
    Group Norm Groups of channels, per sample Object detection, small-batch training