AdaHessian and PyHessian are libraries for second order based optimization and analysis of the neural network training based on PyTorch. The library supports the training of convolutional neural networks (image_classification) and transformer-based models (transformer).

See code at:

• https://github.com/amirgholami/adahessian
• https://github.com/amirgholami/PyHessian