Related: an independent reverse engineering of a network that "grokked" modular ...

		moyix on Jan 16, 2023 \| parent \| context \| favorite \| on: Reverse engineering a neural network's clever solu... Related: an independent reverse engineering of a network that "grokked" modular addition: https://www.alignmentforum.org/posts/N6WM6hs7RQMKDhYjB/a-mec... One interesting thing is that this network similarly does addition using a Fourier transform.