Levenberg Marquardt

Levenberg-Marquardt

\[ x_{i+1} = x_i + (\nabla^2_{f(x_i)}+\lambda \; \text{diag}(\nabla^2_{f(x_i)}))^{-1}\nabla_{f(x)} \]