We're not ideal superhumans. For any one of us, being in a stimulating environment makes us better. And a library unfortunately doesn't provide it. Not that books aren't a good companion at any time.
You're implying that schools are a stimulating environment. For me they were the exact opposite and universities perpetuate the same mind numbing system.