You can annotate any Service of type LoadBalancer in order to configure various aspects[1] of the associated ELB, including which ACM-managed certificate you want to attach to each listener port.
[1] https://github.com/kubernetes/kubernetes/blob/master/pkg/clo...