With this attitude we’d still be driving with leaded gas, living in lead painting rooms with asbestos roofs and spraying ozone layer destroying aerosols amongst a bunch of other things. The mechanism you described only really works with short term safety issues. If it takes years or decades for health problems to develop neither workers nor their employers tend to be particularly bothered about solving them.