I don't think the neural remap is that hard - i mean, you can type, and it doesn't work through a pen and text interpretation.
Having used the controllers and leap motion, the controllers I prefer, as grasping nothing is less immersive than grasping a controller - in my view, anyway.
Now, gloves with feedback, those will be interesting - but are a way off.
I was recently thinking about 3d printing trackable objects to get around the whole topic, and allow leap motion/manus/whatever to be that much more real.