Yeah just doesn't sound plausible to me. I've seen bigger projects take less than a minute on a 2014 desktop.
For big prod builds you'll definitely want to give the JVM at least 1gb of RAM, make sure you actually override Lein's defaults:
:jvm-opts ^:replace ["-Xmx1g" "-server"]