Of course the system is not something that magically descended to the heavens, it is simply what people have agreed to go by. If it is unequal, it is so because the people have decided that they want it to be unequal.
No doubt because, as you point out, the typical person would rather spend their time making ends meet (i.e. pay for the luxuries of life) than the worry about making agreements with their neighbours day-in, day-out. You can technically survive on very little time commitment to "make ends meet". Just look at the homeless population. It is not a life you would want to live, but it could be done if you truly saw the need to assert your power. But, understandably, most people would rather focus on their personal goals and let the figurehead worry about the community problems.
What's the alternative? It's just people at the end of the day. There is no magic. Those who do the work are going to do the work the best way they know how. Even if they value your input and want nothing more than to work with you so that you can show your better way, they are not going to scour the globe to find you. If you don't put the effort in to make yourself known on a regular basis you will be forgotten about.