rapidsai / rapidsai/deployment
Document single-node Dask on Databricks
Nobody has claimed this yet.
- Dominant language
- Jupyter Notebook
- Stars
- 15
- Forks
- 41
- Avg merge
- 1d 8h
- Merged PRs (30d)
- 6
Description
Our current Databricks documentation shows how to launch a Databricks cluster (single and multi-node) with the RAPIDS environment. However, it doesn't actually discuss how to leverage even a SNMG cluster with Dask.
We should add a section on using dask-cuda to create a cluster.
Related issue #228 covers documenting the multi-node setup.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the current Databricks documentation at the linked platform page and review issue #228 to keep the scope distinct from multi-node setup. Add a section explaining how to use dask-cuda with a single-node multi-GPU cluster, and consider the work complete when the single-node workflow is documented alongside the existing launch instructions.
Written by the indexing model from the issue text.
Assessment
- Domain
- documentation
- Issue type
- Documentation
- Difficulty
- 2/5
- Estimated time
- 1-3 hours
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 48/100