Git Re-Basin: Merging Models modulo Permutation Symmetries

Two neural networks $A$ and $B$ of the same architecture and trained by SGD are compared after finding a suitable permutation $\pi$ that …