Yeah, there's a natural tension in this. I know I tend to wander towards the "ship it" category but yet I've found my best work was when I was paired with someone on the "correctness" side of the equation.
It forces a constant re-evaluation of your methods and reasoning on both sides which leads to something even better than the two individual approaches.