PyHessian is a Pytorch library for second-order based analysis and training of Neural Networks

ADAHESSIAN: An Adaptive Second Order Optimizer for Machine Learning

PyTorch implementation of Hessian Free optimisation

PyTorch implementation of the Hessian-free optimizer

On the New method of Hessian-free second-order optimization

Matrix-multiplication-only KFAC; Code for ICML 2023 paper on Simplifying Momentum-based Positive-definite Submanifold Optimization with Applications to Deep Learning

Stochastic Second-Order Methods in JAX

Implementation of numerical optimization algorithms for logistic regression problem.

Fine-tuning LLMs with LoRA and Hessian-free optimizers

Tensorflow implement of Meta Learning with Hessian Free Approach in Deep Neural Nets Training

Course project for CS771A: Introduction to Machine Learning

Implementation of Adaptive Hessian-free optimization.