Gradient Descent

Gradient Descent is an Optimization algorithm that iteratively adjusts parameters to minimize a function. It follows the steepest path downhill, guided by the function's Gradient, until a local minimum is found.

See also

• Machine Learning
• Neural Networks
• Learning Rate
• Backpropagation