I am interested in using Nginx as a load balancer to shard requests across a fleet of docker containers uses consistent hashing and service discovery as described by https://www.nginx.com/blog/dns-service-discovery-nginx-plus/ and https://www.nginx.com/resources/wiki/modules/consistent_hash/. My docker containers are running in AWS ECS, so it looks like Route53 autonaming would be a great way to implement the service discovery: https://aws.amazon.com/blogs/aws/amazon-ecs-service-discovery/
However, I see from the ECS Service Discovery docs that each DNS query only returns up to 8 records. I think this would result in Nginx only sharding across whichever eight records happen to be returned. Are there any common patterns for dealing with this? (Where we want service discovery across and consistent hashing across, say, up to ~100 hosts.)
Thanks and best regards,
Jared