Welcome! Log In Create A New Profile

Advanced

Purging nginx cache by deleting cache files does not always work

Posted by silentmiles 
Purging nginx cache by deleting cache files does not always work
September 09, 2015 07:50PM
I run a PHP webservices API behind an nginx server (1.6.2). I use nginx's fastcgi_cache to cache all GET requests, and when certain resources are updated, I purge one or more related cached resources.

The method I'm using to do this is to calculate the nginx cache file name for each resource I want to purge, and then deleting that file. For the most part, this works well.

However, I've found that sometimes, even after the cache file is deleted, nginx will still return data from cache.

This is not a problem with selecting the correct cache file to delete -- as part of my testing, I've deleted the entire cache directory, and nginx still returns HIT responses

Is anyone aware of why this might be happening? Is it possible that another cache is involved? E.g., could it be that the OS is returning a cached version of the cache file to nginx, so nginx is not aware that it's been deleted?

I'm running this on CentOS, and with this nginx config (minus irrelevant parts):

===================================
user nginx;

# Let nginx figure out the best value
worker_processes auto;

events {
worker_connections 10240;
multi_accept on;
use epoll;
}

# Maximum number of open files should be at least worker_connections * 2
worker_rlimit_nofile 40960;

# Enable regex JIT compiler
pcre_jit on;

http {

# TCP optimisation
sendfile on;
tcp_nodelay on;
tcp_nopush on;

# Configure keep alive
keepalive_requests 1000;
keepalive_timeout 120s 120s;

# Configure SPDY
spdy_headers_comp 2;

# Configure global PHP cache
fastcgi_cache_path /var/nginx/cache levels=1:2 keys_zone=xxx:100m inactive=24h;

# Enable open file caching
open_file_cache max=10000 inactive=120s;
open_file_cache_valid 120s;
open_file_cache_min_uses 5;
open_file_cache_errors off;

server {
server_name xxx;
listen 8080;

# Send all dynamic content requests to the main app handler
if (!-f $document_root$uri) {

rewrite ^/(.+) /index.php/$1 last;
rewrite ^/ /index.php last;
}

# Proxy PHP requests to php-fpm
location ~ [^/]\.php(/|$) {

# Enable caching
fastcgi_cache xxx;

# Only cache GET and HEAD responses
fastcgi_cache_methods GET HEAD;

# Caching is off by default, an can only be enabled using Cache-Control response headers
fastcgi_cache_valid 0;

# Allow only one identical request to be forwarded (others will get a stale response)
fastcgi_cache_lock on;

# Define conditions for which stale content will be returned
fastcgi_cache_use_stale error timeout invalid_header updating http_500 http_503;

# Define cache key to uniquely identify cached objects
fastcgi_cache_key "$scheme$request_method$host$request_uri";

# Add a header to response to indicate cache results
add_header X-Cache $upstream_cache_status;

# Configure standard server parameters
fastcgi_split_path_info ^(.+\.php)(/.+)$;
include fastcgi_params;

# php-fpm config
fastcgi_param SCRIPT_URL $fastcgi_path_info;
fastcgi_param PATH_INFO $fastcgi_path_info;
fastcgi_param SCRIPT_FILENAME $document_root$fastcgi_script_name;
fastcgi_param REQUEST_SCHEME $scheme;
fastcgi_param REMOTE_USER $remote_user;

# Read buffer sizes
fastcgi_buffer_size 128k;
fastcgi_buffers 256 16k;
fastcgi_busy_buffers_size 256k;
fastcgi_temp_file_write_size 256k;

# Keep connection open to enable keep-alive
fastcgi_keep_conn on;

# Proxy to PHP
fastcgi_pass unix:/var/run/php-fpm/fpm.sock;
}
}
}
===================================

Now that I look at this, could the open_file_cache parameters be affecting the cache files?

Any ideas?
Re: Purging nginx cache by deleting cache files does not always work
September 15, 2015 08:29PM
Any ideas on this?
Re: Purging nginx cache by deleting cache files does not always work
September 16, 2015 03:44AM
Are you also updating the memory (keys_zone) ?

---
nginx for Windows http://nginx-win.ecsds.eu/
Re: Purging nginx cache by deleting cache files does not always work
September 19, 2015 03:21AM
No, I'm just deleting the physical file. Does the shared mem cache persist after the file is deleted? Is there a method of flushing the mem cache?
Re: Purging nginx cache by deleting cache files does not always work
September 19, 2015 03:56AM
silentmiles Wrote:
-------------------------------------------------------
> No, I'm just deleting the physical file. Does the shared mem cache
> persist after the file is deleted? Is there a method of flushing the
> mem cache?

There are cleanup routines in nginx which may do some of this work but this code does not assume some external party is deleting the files while nginx is running, have a look at https://github.com/FRiCKLE/ngx_cache_purge/

---
nginx for Windows http://nginx-win.ecsds.eu/
Sorry, only registered users may post in this forum.

Click here to login

Online Users

Guests: 210
Record Number of Users: 8 on April 13, 2023
Record Number of Guests: 421 on December 02, 2018
Powered by nginx      Powered by FreeBSD      PHP Powered      Powered by MariaDB      ipv6 ready