assuming that space traveler had the incredible amount of energy to accelerate long periods of time, interstellar medium would be the limiting factor. There would be upper limit (say 90-99% of the speed of the light) and after that particles, molecules and dust in the space would bee too energetic for the space ship to stay intact.
