Changing the DenseAM kernel from the standard Gaussian kernel to the KDE-optimal Epanechnikov kernel results in 1) exponential capacity without the exponential and 2) meaningful, emergent memories.

SD-KDE improves on previous methods for kernel density estimation by using a noisy estimate of the score function.