Reference

NNGeometry, Thomas George. (2023)

Abstract

{KFAC,EKFAC,Diagonal,Implicit} Fisher Matrices and finite width NTKs in PyTorch