Holding the data you need yourself might work ok for your own personal ETH balance, assuming you have some way to prove the absence of any outgoing transfers. In fact, that's how one variant of Plasma works.

But with smart contracts, it gets a lot more complicated. It's way simpler if you can just know that any data you need will be on the network.