My guess is that it depends on whether you look on marriage as a religious custom or a legal custom. I can understand people not agreeing with it in the religious sense (as their special book says so).
Personally I say give everyone the same rights (i.e single people) and a large part of the problem would go away.