Welcome! Log In Create A New Profile

Advanced

Nginx Consistent Hashing with Service Discovery

Posted by jarstewa 
Nginx Consistent Hashing with Service Discovery
March 04, 2019 09:34PM
I am interested in using Nginx as a load balancer to shard requests across a fleet of docker containers uses consistent hashing and service discovery as described by https://www.nginx.com/blog/dns-service-discovery-nginx-plus/ and https://www.nginx.com/resources/wiki/modules/consistent_hash/. My docker containers are running in AWS ECS, so it looks like Route53 autonaming would be a great way to implement the service discovery: https://aws.amazon.com/blogs/aws/amazon-ecs-service-discovery/


However, I see from the ECS Service Discovery docs that each DNS query only returns up to 8 records. I think this would result in Nginx only sharding across whichever eight records happen to be returned. Are there any common patterns for dealing with this? (Where we want service discovery across and consistent hashing across, say, up to ~100 hosts.)

Thanks and best regards,
Jared
Sorry, only registered users may post in this forum.

Click here to login

Online Users

Guests: 108
Record Number of Users: 6 on February 13, 2018
Record Number of Guests: 421 on December 02, 2018
Powered by nginx      Powered by FreeBSD      PHP Powered      Powered by MariaDB      ipv6 ready