Need guidelines around max memory usage

Nessuno ha ancora preso questa issue.

This is related to #383 and #351 although in this case I'm looking more for guidance than a fix. I understand that mimalloc may overallocate and hold onto RSS after the memory is freed and so a system will need more RAM available to avoid running out of memory.

However, it is not very clear to me exactly how much RAM I will need. I am using mimalloc through Apache Arrow. In some cases, when processing an 8GB dataset, the RSS will grow to 27GB. This has made it difficult to figure out what kind of server we need to purchase / configure even though the size of our data is known. It will be even more difficult for more sophisticated approaches (such as a server that delays requests until the server has enough RAM to process them, ensuring OOM errors are avoided).

It's possible this behavior is a bug or some kind of bad scenario that can be avoided (I'm going to work through the suggestions in #351). However, even if that is the case, I would still like to have a better idea of the maximum amount of RAM that I can expect mimalloc to use.

Inizia leggendo le issue correlate #383 e #351, quindi esamina il comportamento documentato di mimalloc rilevante per la conservazione di RSS e la sovraallocazione. Determina se il progetto può fornire indicazioni utili sulla memoria massima per un carico di lavoro di 8GB e documenta chiaramente condizioni e limitazioni, in modo da guidare il dimensionamento dei server.

Scritto dal modello di indicizzazione a partire dal testo della issue.