Whether you want open firmware in the first place is a significantly different question from how you isolate hardware with closed firmware.
But more directly, worrying about one part having a backdoor is a lot better than worrying about twenty parts having a backdoor.