Hello!

On Tue, Mar 12, 2019 at 02:09:06PM -0400, wkbrad wrote:

> First of all, thanks so much for your insights into this and being patient
> with me. :) I'm just trying to understand the issue and what can be done
> about it.
>
> Can you explain to me what you mean by this?
> > you can configure system allocator to use mmap()
>
> I'm not a C programmer so correct me if I'm wrong, but doesn't the Nginx
> code determine which memory allocator it uses?

Normally C programs use malloc() / free() functions as provided by
system libc library to allocate memory. While it is possible for
an application to provide its own implementation of these
functions, this is something rarely used in practice.

> If not can you point me to an article that describes how to do that as I
> would like to test it?

For details on how to control system allocator on Linux, please
refer to the mallopt(3) manpage, notably the
MALLOC_MMAP_THRESHOLD_ environment variable. Web version is
available here:

http://man7.org/linux/man-pages/man3/mallopt.3.html

Please refer to the M_MMAP_THRESHOLD description in the same man
page for details on what it does and various implications.

Using a values less than NGX_CYCLE_POOL_SIZE (16k by default)
should help to move all configuration-related allocations into
mmap(), so these can be freed independently. Alternatively,
recompiling nginx with NGX_CYCLE_POOL_SIZE set to a value larger
than 128k (default mmap() threshold) should have similar
effect.

Note though that there may be other limiting factors,
such as MALLOC_MMAP_MAX_, which limits maximum number of mmap()
allocations to 65536 by default.

You can also play with different allocators by using the
LD_PRELOAD environment variable, see for example jemalloc's wiki
here:

https://github.com/jemalloc/jemalloc/wiki/Getting-Started

> Also, you seem to be saying that Nginx IS attempting to free the memory but
> is not able to due to the way the OS is allocating memory or refusing to
> release the memory. I've tested this in several Linux distros, kernels, and
> Nginx versions and I see the same behavior in all of them. Do you know of
> an OS or specific distro where Nginx can release the old memory allocations
> correctly? I would like to test that too. :)

Any Linux distro can be tuned so freed memory will be returned to
the system, see above. And for example on FreeBSD, which uses
jemalloc as a system allocator, unused memory is properly returned
to the system out of the box (though can be seen in virtual
address space occupied by the process, since the allocator uses
madvise() to make the memory as unused instead of unmapping a
mapping).

--
Maxim Dounin
http://mdounin.ru/
_______________________________________________
nginx mailing list
nginx@nginx.org
http://mailman.nginx.org/mailman/listinfo/nginx