I think that point of view is fine on an individual level. For people who like to live a minimalist lifestyle and don't want to be tied down to a location or want to be able to pack up and move easily, or just plain hate clutter and don't find enough personal value in owning these things that's fine (although you can store a lot on a single external hard drive nowadays).
But I don't think this is a good idea for the world to become like this as a whole. The more things are centralized (stream from one server as opposed to living in a bunch of locations all over the world), the easier it is for parts of our culture to disappear.
The artifacts we find from thousands of years ago are a super tiny handful of many, many, many more that existed (perhaps not exact copies, but the same types of things), and we have lost who knows how knowledge and cultural artifacts from the past, in particular the ancient past, due to things like libraries and museums getting burned down or destroyed, statues being removed, massive wars fought, etc.
Even in our own lifetimes there have been the Taliban that have destroyed ancient Buddhist statues in Afghanistan[1], ISIS destroying artifacts in Iraq museums[2], and looters destroying or stealing artifacts from a Cairo museum while the Arab Spring was underway[3]. Along with many, many other examples[4].
We collectively have the capability to have exact or near-exact copies of all sorts of documents, art, video, audio, etc. The more people that hang on to these things, the more future generations benefit from it. And the more we can benefit from the archival actions of others now.
But again, it doesn't require that everyone do it, or even for each person to try to have a copy of literally everything that exists. Just that enough people own copies of the things they love and share them with people as much as they can, helps insure the survival of our cultural heritage.
BTW, I found an interesting site that chronicles all the various types of media that are known to have existed but are now lost. It's called LostMediaWiki, if you're curious. I was surprised how long the list was just for video games, which aren't that old as a medium.
[1] https://en.wikipedia.org/wiki/Buddhas_of_Bamiyan
[2] https://en.wikipedia.org/wiki/Destruction_of_Mosul_Museum_ar...
[3] https://www.bbc.com/news/world-middle-east-12442863
[4] https://en.wikipedia.org/wiki/List_of_destroyed_heritage