JuliaParallel / JuliaParallel/Dagger.jl

DArray: Memory cannot GC when the variables are reassigned, causing `Out of Memory` error or halting problem

Open
#649 6 comments 0 reactions 0 assignees View on GitHub
memory usage
Dominant language
Julia
Stars
723
Forks
90
Avg merge
1d 37m
Merged PRs (30d)
9

Description

MWE:
```jl
using DistributedNext
addprocs(8)
@everywhere using Dagger

N = 1024
a = zeros(N,N,N); # 8GB

b = DArray(a); #! Repeat this, and the CPU memory keeps growing until the Julia session is killed by system
```

I have tried the followings but the memory occupation cannot decrease:
```jl
b = nothing;

GC.gc()

@everywhere GC.gc()
```

Is there a way to reuse or manually release the memory of `DArray`? I cannot find any solution in the documentation or github issues.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.