If this were true, wouldn't Google display all million pages that are vaguely relevant to my query on the first screen?
Their only job is to stack order the internet. Down ranking a site to the 1,000,000th result is the same as banning them. They necessarily do this all the time (like for every search with more than 10 potential hits).
