Welcome! Log In Create A New Profile

Advanced

Re: How does Nginx look-up cached resource?

Maxim Dounin
September 04, 2015 09:24AM
Hello!

On Thu, Sep 03, 2015 at 06:39:49PM -0700, Shuxin Yang wrote:

> I'm Nginx newbie. I have a question regarding how nginx lookup a cached
> resource.
>
> As far as I can tell, given a cache-key k. Nginx uses crc32(k) as as the
> key to lookup
> the cached resource in a RB tree, and use md5(k) verify if conflict take
> place; the
> key k per se is not used for looking up resource. Is my understanding
> correct?

No, vice versa.

MD5 is used to identify a resource, and CRC32 is used to
additionally verify if there are any collisions. If any collision
is detected, nginx will complain loudly.

As of now, the only case when the message about a collision was
seen, it was the result of a bug, not a collision.

> If so, how can we guarantee that crc32 and md5 combined can uniquely
> identify a resource?

We can't. Collisions are unavoidable if you use a hash function
with more inputs than outputs. The question is how often
collisions are observed in practice.

--
Maxim Dounin
http://nginx.org/

_______________________________________________
nginx-devel mailing list
nginx-devel@nginx.org
http://mailman.nginx.org/mailman/listinfo/nginx-devel
Subject Author Views Posted

How does Nginx look-up cached resource?

Shuxin Yang 940 September 03, 2015 09:40PM

Re: How does Nginx look-up cached resource?

Maxim Dounin 305 September 04, 2015 09:24AM

Re: How does Nginx look-up cached resource?

Sergey Brester 347 September 04, 2015 11:38AM

Re: How does Nginx look-up cached resource?

Maxim Dounin 337 September 04, 2015 02:12PM

Re: How does Nginx look-up cached resource?

Sergey Brester 446 September 04, 2015 02:58PM

Re: How does Nginx look-up cached resource?

Maxim Dounin 297 September 04, 2015 03:44PM

Re: How does Nginx look-up cached resource?

Sergey Brester 333 September 04, 2015 05:02PM

Re: How does Nginx look-up cached resource?

Maxim Dounin 342 September 05, 2015 08:10PM

Re: How does Nginx look-up cached resource?

Sergey Brester 385 September 07, 2015 09:36AM

Re: How does Nginx look-up cached resource?

Maxim Dounin 361 September 07, 2015 12:20PM

Re: How does Nginx look-up cached resource?

Sergey Brester 302 September 07, 2015 12:34PM

Re: How does Nginx look-up cached resource?

Gena Makhomed 362 September 04, 2015 05:22PM

Re: How does Nginx look-up cached resource?

Maxim Dounin 326 September 05, 2015 09:58PM

Re: How does Nginx look-up cached resource?

Gena Makhomed 306 September 07, 2015 10:46AM

Re: How does Nginx look-up cached resource?

Maxim Dounin 292 September 07, 2015 01:00PM

Re: How does Nginx look-up cached resource?

Gena Makhomed 431 September 07, 2015 03:30PM

Re: How does Nginx look-up cached resource?

Sergey Brester 405 September 07, 2015 05:24PM

Re: How does Nginx look-up cached resource?

Gena Makhomed 558 September 07, 2015 07:20PM

Re: How does Nginx look-up cached resource?

Maxim Dounin 478 September 07, 2015 09:42PM

Re: How does Nginx look-up cached resource?

Gena Makhomed 440 September 08, 2015 05:08PM

Re: How does Nginx look-up cached resource?

Maxim Dounin 466 September 09, 2015 01:18PM

Re: How does Nginx look-up cached resource?

Sergey Brester 337 September 10, 2015 05:58AM

Re: How does Nginx look-up cached resource?

Sergey Brester 332 September 10, 2015 08:56AM

Re: How does Nginx look-up cached resource?

Maxim Dounin 357 September 10, 2015 10:48AM

Re: How does Nginx look-up cached resource?

Sergey Brester 319 September 10, 2015 11:08AM

Re: How does Nginx look-up cached resource?

Maxim Dounin 322 September 10, 2015 11:34AM

Re: How does Nginx look-up cached resource?

Sergey Brester 332 September 10, 2015 11:56AM

Re: How does Nginx look-up cached resource?

Maxim Dounin 346 September 10, 2015 01:00PM

Re: How does Nginx look-up cached resource?

Sergey Brester 610 September 10, 2015 04:54PM



Sorry, you do not have permission to post/reply in this forum.

Online Users

Guests: 254
Record Number of Users: 8 on April 13, 2023
Record Number of Guests: 421 on December 02, 2018
Powered by nginx      Powered by FreeBSD      PHP Powered      Powered by MariaDB      ipv6 ready