JuliaParallel / JuliaParallel/Dagger.jl
DArray: Memory cannot GC when the variables are reassigned, causing `Out of Memory` error or halting problem
Open
memory usage
- Dominant language
- Julia
- Stars
- 723
- Forks
- 90
- Avg merge
- 1d 37m
- Merged PRs (30d)
- 9
Description
MWE:
```jl
using DistributedNext
addprocs(8)
@everywhere using Dagger
N = 1024
a = zeros(N,N,N); # 8GB
b = DArray(a); #! Repeat this, and the CPU memory keeps growing until the Julia session is killed by system
```
I have tried the followings but the memory occupation cannot decrease:
```jl
b = nothing;
GC.gc()
@everywhere GC.gc()
```
Is there a way to reuse or manually release the memory of `DArray`? I cannot find any solution in the documentation or github issues.
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.