For visual mode, apparently I just press v again. (I had to try it and see if I was subconsciously triggering Esc).
I had already weened myself off the Esc key, so the touchbar isn't that big a deal for me (though, i dont really ever use it). The terrible keyboard reliability is much worse, ugh.