No. You are trading uncertain gains of tax avoidance (to cast it in the nicest possible terms) for the certain cost of complications and distraction.
You will certainly incur several thousand dollars in immediate costs for legal advice, filing fees, etc. You will have to pay a registered agent in a foreign country, etc., on an ongoing basis, which could be several hundred to a few thousand dollars per year for effectively forever.
You will also have potential issues with having to answer questions about whether you hold any financial assets offshore in the future. If you are, or become, a U.S. taxpayer, you have to disclose if you have aggregate of over $10,000 in overseas holdings. Including the holding company. You can guarantee that this makes you of much more intense interest for audit. If you lie about it, you set yourself up for penalties and possible criminal charges.
It will also just look weird to investors, company auditors, etc., if some offshore entity holds the shares instead of you. It won't be necessarily suspect, but it will be a distraction. Unless you have a substantial personal fortune already, in which case you likely already have estate-planning or tax-planning advisors and entities formed, it will just look bizzare.
In general, for a U.S. entrepreneur starting at zero and concerned about tax minimization, making sure you get long-term capital gains treatment and get your 83(b) election right is the most important. Next is trying to get Qualified Small Business Stock treatment.