That's true. If I weren't using java, I wouldn't have had to use a singleton. That's as much of a problem with singletons as it is an over-reliance on the object-oriented style.
I suspect dependency injection has the same problem: you could achieve the same results in a non-object-oriented language.