Translations:Adam A Method for Stochastic Optimization/24/en

    From Marovi AI

    The paper provided a convergence analysis showing that Adam achieves an $ O(\sqrt{T}) $ regret bound in the online convex optimization framework, matching the best known bounds for adaptive methods.