dask/dask-yarn

View on GitHub

Deploy dask on YARN clusters

Stars: 69
Forks: 40
Open beginner issues: 0
Indexed issues: 30

Dominant language: Python
License: BSD-3-Clause
Last GitHub push: Jun 6, 2022
Latest indexed: Sep 15, 2026
Contributing guide: Contributing guide
Code of conduct: No code of conduct
Beginner labels: No beginner labels indexed
PR merge metrics: No merged PRs in 30d

Open All

30 open issues indexed

Specify scheduler node Open

dask/dask-yarn#26 · 7 comments · 1 reaction · 0 assignees · Indexed Sep 15, 2026
Modify the dask dashboard to work through the yarn proxy Open

dask/dask-yarn#27 · 0 comments · 4 reactions · 0 assignees · Indexed Sep 15, 2026
Schedulers and workers not using personal config Open

dask/dask-yarn#42 · 8 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Add option to distribute files to workers Open

dask/dask-yarn#50 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
dask-yarn not requesting the exact number of workers i specified Open

dask/dask-yarn#59 · 14 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Allow forwarding CLI options Open

dask/dask-yarn#69 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
MapR non-standard Hadoop security not supported Open

dask/dask-yarn#70 · 14 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Submit (long running) Yarn Cluster via CLI w/out Client Script Open

dask/dask-yarn#90 · 3 comments · 1 reaction · 0 assignees · Indexed Sep 15, 2026
Inherit from upstream Cluster class Open

dask/dask-yarn#95 · 1 comment · 1 reaction · 0 assignees · Indexed Sep 15, 2026
document status dashboard needs bokeh better? Open

dask/dask-yarn#112 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
[feature request] maximizeResourceAllocation option Open

dask/dask-yarn#113 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Start a Dask cluster with EMR cluster programmatically Open

dask/dask-yarn#121 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
EMR bootstrap script fails Open

dask/dask-yarn#122 · 18 comments · 2 reactions · 0 assignees · Indexed Sep 15, 2026
Cluster and Client creation error when using EMR Open

dask/dask-yarn#124 · 4 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Not working when the worker node has multiple IPs Open

dask/dask-yarn#126 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Using dask-yarn + EMR encountering InvalidStateError when doing cluster.close() Open

dask/dask-yarn#127 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Migrate CI to GitHub Actions Open

dask/dask-yarn#128 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
issue while running on azure HDinsight cluster Open

dask/dask-yarn#131 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
AWS EMR bootstrap script fails Open

dask/dask-yarn#133 · 5 comments · 1 reaction · 0 assignees · Indexed Sep 15, 2026
Conda environment does not activate Open

dask/dask-yarn#134 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Dask Scheduler host/port Not Written to Skein Key-Value Storage When YARN Application Restarts Open

dask/dask-yarn#135 · 5 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
YarnCluster.shutdown() Won't Work on EMR, results in `concurrent.futures._base.CancelledError` Open

dask/dask-yarn#138 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
wait_for_workers got stuck when to create cluster but application failed on yarn Open

dask/dask-yarn#146 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
register workers of scheduler are less than workers in dashborad Open

dask/dask-yarn#148 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Jupyter Notebook Cell Hangs after submitting job to remote EMR cluster Open

dask/dask-yarn#154 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
distributed 2022.3.0 no more compatible with dask-yarn because of missing "status" attribute in YarnCluster Open

dask/dask-yarn#155 · 7 comments · 2 reactions · 0 assignees · Indexed Sep 15, 2026
YarnCluster() does not initialize but runs indefinetly Open

dask/dask-yarn#157 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
.skein.sh: line 2: environment/bin/python: No such file or directory Open

dask/dask-yarn#159 · 4 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Bootstrapping for 40min, when use the script. Open

dask/dask-yarn#160 · 2 comments · 1 reaction · 0 assignees · Indexed Sep 15, 2026
Issue with deprecated format_bytes Open

dask/dask-yarn#161 · 3 comments · 1 reaction · 0 assignees · Indexed Sep 15, 2026

dask/dask-yarn

Get new issues in your inbox