These are interesting reads, and it seems that reversible computers suffer the same problem, physically. If I want to actually make a reversible computer, I still have to make the blank tape that it uses.
Precisely: and that issue (among many others) is the one ding dongs in "quantum information" sweep under the carpets and hope you don't notice. It's HUGELY OBVIOUS if you try to do it for an HP42 calculator tier computer. Somehow the mystification of adding entanglement to the mess pushes it off into "Hilbert space" and nobody notices.