cannot fulfill requested CSI volume mounts on 1 node

Hey guys,

So I was trying to setup Docker Swarm cluster with CSI plugin (ghcr.io/cloud-skeleton/democratic-csi-swarm).

I have installed it on all nodes:

ID             NAME                          DESCRIPTION                              ENABLED
2a8d168b768a   democratic-csi-swarm:latest   Democratic CSI plugin for Docker Swarm   true

On manager node I can create volume directly with cli:

docker volume create \
  -d democratic-csi-swarm \
  --group system \
  --label eu.cloudskeleton.volume=true \
  --label eu.cloudskeleton.volume.type=system \
  --scope multi \
  --sharing all \
  --required-bytes 10737418240 \
  --topology-required eu.cloudskeleton.node=true \
    proxy

and all's good, HOWEVER I have tried everything and I can not achieve same result with compose.yml:

services:
  test:
    ...
    volumes:
      - source: proxy
        target: /data/traefik/configs
        type: cluster

volumes:
  proxy:
    driver: democratic-csi-swarm
    driver_opts:
      group: system
      required-bytes: 10737418240
      scope: multi
      sharing: all
      topology-required: eu.cloudskeleton.node=true
    labels:
      eu.cloudskeleton.volume: "true"
      eu.cloudskeleton.volume.type: system

Deployment would always fail with:

cannot fulfill requested CSI volume mounts on 1 node

Start by reproducing the failure from the provided compose.yml and compare it with the working docker volume create command. Trace how the compose volume options and topology requirement become the requested CSI volume mounts, then verify that deployment no longer reports "cannot fulfill requested CSI volume mounts on 1 node".