Yes, you're right. The point is, with bitcoin, there's really no need for banks.
It's easier (and safer) for me to hold a million dollars in bitcoin than a million dollars in cash. If I had a million dollars in cash, I'd be constantly worried that someone will find it and steal it. Hence the need for a bank. I feel much more capable hiding a private key, which is just information, than I do hiding 10,000 pieces of paper, which is physical.
