Not really. The point of the requirement is to subsidize the health care you will get if they find you unconscious, naked in a ditch without ID and can't tell if you are wealthy enough to pay or not.
Absent insurance, that privilege is paid for by the higher prices charged to people unlucky enough to need healthcare.
Now, if you can't get plans that consider the fact that you are only in the US for < 100 days a year, then yes it's harsh.