Alternatively, take a directed graph with:

V = The integers

E = {x, y | x - y = 1}

and that graph has the same isomorphism group.

Replace the nodes of that graph with asymmetric graphs, and the resultant undirected graph again has the same isomorphism group.