No idea how I missed that. Thank you very much!

Also for people that might find this thread later:

Adding the parameter "updating" to the directive "proxy_cache_use_stale" is important as well if you want to minimize the traffic the origin server generates.

proxy_cache_use_stale updating;
proxy_set_header Range "";