Sure; if you can predict the future, and the future happens to be that the crosswindws will oppose each other, then you can just set your heading and get there.
However, if the wind doesn't shift you are now taking even longer to get there because you'll have to turn to go straight upwind once your destination is directly upwind from you.
This crazy world you describe applies in a different axis! Vertical movement of air happens on a much smaller scale, so it tends to cancel out as you fly through it. If you climb in the updrafts and descend in the downdrafts, you only make it worse. Better to ride it out.