An optimization algorithm is a method for finding a better or best solution according to an objective, constraint, or loss function.
In machine learning, optimization algorithms guide how model parameters are adjusted during training.