I posted another comment on this, but I never found this to be an issue when using dvorak or workman. Just as I slowly relearned to type the letters at all and improved over time, I kept using vim and got used to hjkl being moved over time. It doesn't bug me at all.
Interesting. I guess the difference here is that I learned vim after neo2 (https://neo-layout.org), not before. That way I already had proper arrow keys in my home row and hjkl felt cumbersome and redundant.
