Optimization Methods

Implementation of numerical optimization algorithms for logistic regression problem.

Algorithms:

Gradient descent with different line search methods
Newton method
Hessian free Newton with conjugate gradients method
BFGS & L-BFGS
Stochastic gradient descent
Adam