This paper shows fairly conclusively that the network 'groks' modular addition.
This is what it is. Not "general arithmetic".