Even so, violence isn't so much the basis for society itself, just the govt. And either way, it's only how outliers are dealt with. Most of what most people do all day every day is constrained by things like their family and peers' expectations and their commitments. I'd say social structures are primarily based on cultural norms.