Hams make an entire sport of of this ("fox hunting"), and the FCC has a network of automated monitoring stations dotted across the country specifically to determine the location of rogue radio transmissions.
That said, most of the time it's easier to just ignore the radio trolls.