Translations:Batch Normalization Accelerating Deep Network Training/15/en

    From Marovi AI

    During training, the mean and variance are computed per mini-batch. During inference, batch statistics are replaced with population statistics — running averages accumulated during training — so that the output for a single sample is deterministic and does not depend on other samples in the batch.