Freedom to roam does not need to be freedom to enter people's garden. At least in Norway, the law requires you to stay a minimum distance from dwellings, and has a variety of requirements to ensure you're not a nuisance.
There are many possible tradeoffs there other than specifically the Norwegian or Swedish variants to allow most activities unhindered without affecting landowners much.
