We were waaaaay too big to fit in lambda layers. Our containers were 8GB when I left, and that was using all sorts of tricks on the host infra to share data between running containers.
The root of the problem was we had third party tools which were windows only.