I suspect their job has gotten way harder. It's easy to forget that they aren't just passively indexing. The web is basically google's adversary, with every page trying to be top ranked regardless of whether it "should" be.
If it wasn't AdWords, it'd be something else. People build websites because they want their content to be seen. That means competing for search result ranking.
