Is this at least partly due to higher resolution / larger displays? Better quality displays with higher resolution sources will make a difference between out-of-focus and in-focus more apparent.
Barry Lyndon was shot with an f/0.7 lens because Kubrick wanted period-correct lighting: candlelight, which required a super fast lens with the film used. To my knowledge he wasn’t going for shallow DoF.