Glossary:Gradient Descent
Glossary · machine learning, optimization, calculus
Also known as: GD, batch gradient descent, steepest descent
Related: Glossary:Stochastic_gradient_descent, Glossary:Learning_rate
beginner
An iterative optimization algorithm that minimizes a differentiable function by repeatedly moving in the direction of steepest descent, as defined by the negative of the gradient evaluated at the current point.