It totally depends. A weakened structure can hold pressurization for a while, and then suddenly (and possibly catastrophically) fail.
A famous example of this is American Airlines flight 96 (1972): https://en.wikipedia.org/wiki/American_Airlines_Flight_96