Not only are we going to be able to start modifying zygotes like you've mentioned, we're going to be able to start generating them from any genetic material available[0], and bringing them to term in an artificial womb[1].
This is going to fundamentally alter society (for the wealthy at first as you mention) because we will be able to do away with the health burdens that are placed on women who go through pregnancy and we will be able to eliminate huge swaths of genetic abnormalities.
Imagine the shock to paternity law once some unscrupulous individual obtains a celebrities DNA through some discarded water bottle and generates children from it to demand child support payments with.
How will organized sports handle genetically modified players being vastly superior to ungenetically modified?
It's going to be huge, it'll make the pill seem quaint and I feel it's just around the corner, like 2030's sort of thing and no one is talking about.
[0] https://www.timesofisrael.com/from-just-skin-cells-israeli-l...
[1] https://www.theguardian.com/lifeandstyle/2020/jun/27/parents...