We're a small shop; each of our clusters are currently a couple dozen static servers at most. So we don't really do anything at what would be considered "at scale". For us, developer ease of use and performance is a higher priority.
But we're slowly moving towards a setup where we'll likely rely on autoscaling, and where we will likely need a more robust architecture.