dask / dask/dask-docker

in 2024.1.1 and forward: VersionMismatchWarning: Mismatched versions found

Open
#318 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
243
Forks
152
Avg merge
3d 8h
Merged PRs (30d)
1

Description

2024.1.1+ reporting a warning that prevents me from running tasks on workers. Occurs whether I use the images from the repo or if I build it myself.

```
git clone https://github.com/dask/dask-docker.git
cd dask-docker/build

docker compose build
docker compose up
```

In the notebook:
```
from dask.distributed import Client
client = Client()
client.ncores()
```

Yields:
```
/opt/conda/lib/python3.10/site-packages/distributed/client.py:1393: VersionMismatchWarning: Mismatched versions found

+---------+-----------------+-----------------+-----------------+
| Package | Client | Scheduler | Workers |
+---------+-----------------+-----------------+-----------------+
| python | 3.10.14.final.0 | 3.10.12.final.0 | 3.10.12.final.0 |
| toolz | 0.12.1 | 0.12.0 | 0.12.0 |
+---------+-----------------+-----------------+-----------------+
warnings.warn(version_module.VersionMismatchWarning(msg[0]["warning"]))
```

and to do a build myself, I had to edit the docker file and specify a local path for the docker-stacks-foundation. Otherwise I get:

```
=> ERROR [docker-stacks-foundation internal] load git source github.com/jupyter/docker-stacks.git#main:docker-stacks-foundation
...
failed to solve: failed to read dockerfile: failed to open subdir docker-stacks-foundation: open /var/lib/docker/overlay2/zgon1olq8ugp5gx5mdhitexts/diff/checkout1643403295/docker-stacks-foundation: no such file or directory
```

This is happening on Ubuntu 22.04 and when I deploy tasks to AWS Fargate.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.