Variational Learning Finds Flatter Solutions at the Edge of Stability

A new minimalist example to understand the Edge of Stability and Progressive Sharpening phenomenon

We reveal that Edge of Stability dynamics enhance the alignment between the Neural Tangent Kernel and the target.