Translations:Batch Normalization/26/en
| Method | Normalizes over | Use case |
|---|---|---|
| Batch Norm | Batch and spatial dims, per channel | CNNs with large batches |
| Layer Norm | All channels and spatial dims, per sample | Transformers, RNNs, small batches |
| Instance Norm | Spatial dims only, per sample per channel | Style transfer, image generation |
| Group Norm | Groups of channels, per sample | Object detection, small-batch training |