apache / apache/arrow

[R] Problem retrieving memory used after gc() using arrow library

Open
#36,161 10 comments 0 reactions 0 assignees View on GitHub
Component: R Type: bug
Dominant language
C++
Stars
17.1k
Forks
4.3k
Avg merge
3d 13h
Merged PRs (30d)
88

Description

Attachments :

[r_code.txt](https://github.com/apache/arrow/files/11786956/r_code.txt)
[r_code_with_output.txt](https://github.com/apache/arrow/files/11786957/r_code_with_output.txt)
![ram_windows](https://github.com/apache/arrow/assets/37696449/21fb6333-a1e9-43be-958a-89e7090f0030)

Hello,

I'm using R versions 4.1.3 and 4.2.1 on Windows and I'm having a problem with memory usage.

Currently, I need to use the arrow and dplyr libraries in a program and when I compare the memory used between the windows task manager and the memory.size(max=F) function, the one given by the windows task manager is much larger, 243.5 MB, than the one given by the memory.size(max=F) function, 75.77 MB.

However, I delete objects created with rm() and then use the gc() function to recover the memory used by the object.

Below, with and without ouput, the R code I used to present my problem :

Do you think this memory difference is normal?
Could it be caused by the libraries used and/or by bad practices in using the R language?

Thank you for your help, and I remain at your disposal for any further information you may require.

Best regards,

### Component(s)

R

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.