I'm also an Emacs guy, but I agree with the post's assessment of the complexity of starting out with Emacs vs. another editor.
I prefer Emacs because it is so easy to switch between buffers holding different files, or different places in the same file, because it has keyboard macros, its infinite customizability, Org-Mode, etc., etc.
But that's a lot to learn, and if you are trying to learn Clojure, you should use whatever allows you to focus on the language itself.