While certain uses of the symbols are not illegal, they do have a negative effect on age ratings / classification board approvals (relevant to this discussion).

A famous example, is that Wolfenstein 3D was outright refused a rating in Germany. Arguably it may have been legal as artistic use, rather than propaganda promoting an unconstitutional organization, but that was not sufficient to get a rating.