Thanks a lot for your reply.
Unfortunately, according to what I read (on the internet) there is no way to limit connections per client with varnish so I think I will simply remove it.
Thanks again.