Same with everything ever, some users have hundreds of thousands of followers, I'm not sure how you would do it without pagination.

The limits are tight. It's true. But pagination is not the enemy.

I think better scaling of the pricing tiers could help but Twitter probably doesn't care enough about small devs.