Would it wreck the legal framework to institute a concept wherein you can appeal, but if, on appeal, the lower court ruling holds, the punishment/fine is retroactive to the date of the lower court ruling?
I.e., make it so that there is no free pass to continuing presumptively illegal activity.