dask / dask/dask-cloudprovider
ECS import fails with " failed to start"
- Dominant language
- Python
- Stars
- 147
- Forks
- 119
- PR merge metrics
- No merged PRs in 30d
Description
>>> from dask_cloudprovider.aws import ECSCluster
>>> cluster = ECSCluster(
... cluster_arn="arn:aws:ecs:us-west-2:131360002788:cluster/ejansen-cluster-3",
... n_workers=2,
... worker_gpu=1,
... fargate_scheduler=True
... )
Traceback (most recent call last):
File "", line 5, in
File "/home/ubuntu/.local/lib/python3.6/site-packages/dask_cloudprovider/aws/ecs.py", line 727, in __init__
super().__init__(**kwargs)
File "/home/ubuntu/.local/lib/python3.6/site-packages/distributed/deploy/spec.py", line 276, in __init__
self.sync(self._start)
File "/home/ubuntu/.local/lib/python3.6/site-packages/distributed/deploy/cluster.py", line 183, in sync
return sync(self.loop, func, *args, **kwargs)
File "/home/ubuntu/.local/lib/python3.6/site-packages/distributed/utils.py", line 340, in sync
raise exc.with_traceback(tb)
File "/home/ubuntu/.local/lib/python3.6/site-packages/distributed/utils.py", line 324, in f
result[0] = yield future
File "/home/ubuntu/.local/lib/python3.6/site-packages/tornado/gen.py", line 762, in run
value = future.result()
File "/home/ubuntu/.local/lib/python3.6/site-packages/dask_cloudprovider/aws/ecs.py", line 924, in _start
await super()._start()
File "/home/ubuntu/.local/lib/python3.6/site-packages/distributed/deploy/spec.py", line 304, in _start
self.scheduler = await self.scheduler
File "/home/ubuntu/.local/lib/python3.6/site-packages/dask_cloudprovider/aws/ecs.py", line 162, in _
await self.start()
File "/home/ubuntu/.local/lib/python3.6/site-packages/dask_cloudprovider/aws/ecs.py", line 284, in start
raise RuntimeError("%s failed to start" % type(self).__name__)
RuntimeError: Scheduler failed to start
**What happened**:
I'm trying to test NVIDIA RAPIDS functionality using Dask following this guide:
https://rapids.ai/cloud#AWS-EC2
First issue following the manual is the requirement of using dask_cloudprovider.aws instead of dask_cloudprovider.
The second issue is that dask never completes the import and fails with the above error.
**What you expected to happen**:
I was expecting the cluster to be imported.
**Minimal Complete Verifiable Example**:
Follow the guide https://rapids.ai/cloud#AWS-EC2
```python
>>> from dask_cloudprovider.aws import ECSCluster
>>> cluster = ECSCluster(
... cluster_arn="arn:aws:ecs:us-west-2:xxxxxxxxxx:cluster/ejansen-cluster-3",
... n_workers=2,
... worker_gpu=1,
... fargate_scheduler=True
# Put your MCVE code here
```
**Anything else we need to know?**:
**Environment**:
- Dask version:
dask_cloudprovider-0.5.1
- Python version:
python3
- Operating System:
Ubuntu
- Install method (conda, pip, source):
pip
Thanks!
Eddo
Contributor guide
Assessment
This issue has not been assessed yet.