NVIDIA / NVIDIA/raft

Move to Dask nightlies in CI

Open
#677 2 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Cuda
Stars
1k
Forks
251
Avg merge
1d 8h
Merged PRs (30d)
31

Description

Currently we have code here that is installing Dask & Distributed from source. This was needed as there were not nightlies previously

https://github.com/rapidsai/raft/blob/9ed013f48d1894e12ee84151415330f3d3c26230/ci/gpu/build.sh#L73-L78

However Dask & Distributed now provide nightlies ( https://github.com/dask/community/issues/76 ), which can be used instead.

Changes have been made to cuDF ( https://github.com/rapidsai/cudf/pull/10182 ) and Dask-CUDA ( https://github.com/rapidsai/dask-cuda/pull/897 ) to use these nightlies.

Would be good if we could use these in cuML as well.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with ci/gpu/build.sh at the linked lines where Dask and Distributed are installed from source. Check the current CI installation flow and the cuDF and Dask-CUDA nightly changes for guidance; done means cuML's CI installs the available nightlies instead of building those packages from source.

Written by the indexing model from the issue text.

Assessment

Tech stack
shell
Domain
ci-cd
Issue type
Refactor
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
38/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.