JuliaData / JuliaData/MemPool.jl
Add mechanism to generate DRef from file
Nobody has claimed this yet.
- Dominant language
- Julia
- Stars
- 25
- Forks
- 16
- Avg merge
- 4h 56m
- Merged PRs (30d)
- 1
Description
At the moment, creating a new DRef requires the associated data to be in memory. This makes it annoying to persist datasets and be able to easily re-load them in a future session. We should provide a means to generate a new DRef from a file stored on a device, and provide some high-level API (maybe another kwarg to poolset) to expose this.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reading the DRef creation path and the poolset API, which are the entry points named in the issue. Define how a file-backed dataset should be loaded and exposed through the high-level API; done means a DRef can be created from a device file and the dataset reloaded in a later session.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- julia
- Domain
- database
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100