As long as discussion of a work that has published is not impeded, the public is not harmed even by these 50-years after life copyrights other than by that they are accumulated by certain companies who themselves become problems.
When someone decides to use someone's work without compensation he is, even though he is not deprived of the work itself, still robbed. But it's not a theft of goods, it's theft of service. The copyright infringer isn't the guy who steals your phone, it's the guy who even you have done some work for but who refuses to pay.
With this view you can also believe, without hypocrisy, that what the LLM firms are doing is wrong while what Schwartz did was not, since the authors in question weren't deprived of any royalties or payments due to them due to due to the publishing model for scientific works.