That’s actually quite doable in a garage, assuming you are satisfied with, say, two inch wafers. (Currently, they are approaching 18 inches!)
It’s much easier to produce silicon ingots than to do wafer fab, because of the currently tiny line widths.
But, it would make more sense to simply buy wafers (or epitaxial wafers).