I'm against non-competes, but likening them to slavery seems distasteful. I'm not sure they infringe on people's freedoms or rather a specific people's freedoms the way slavery did/does. No one is going to secede over non-competes.
It illustrates the way the "leave it up to the states" argument grates on some ears. It's a slippery slope argument, which is not automatically faulty. It is a call to know how you expect things to not slide down.
If the suggestion is "anything shy of complete chattel slavery", people get worried.