one of the core elgg coders was speaking about using the X-Sendfile header to bypass php processing and serve the file directly, though i don't know enough about how the architecture of nginx/php would handle that to know if it would help here or not.