Agreed, I'm a big fan of Java and have written client software with it but the annoyances are rapidly beginning to outweigh the benefits. Bad press, awful UI support on OS X, Web Start's seeming disappearing/reappearing act... What's the point anymore?
What do you like instead? AFAIK there really isn't any good cross-platform client software development environment, particularly if you care about the Mac. My impression is that Java is no more or less crap than everything else.