> The better way is to design it from the ground up with a bunch of instrumentation that keeps all of your invariants under close observation and that stops the moment anything is not according to your assumptions.
Any personal "war stories" you are willing to share explaining how you went about designing such a system? :-) Or any presentation of someone who did that?