Podman: Error: volume-driver: invalid mount option

Getting closer: It looks like the repo clone step was finished successfully on the remote podman system. It fails after that and offers running a recovery Container, which fails as well.

[9 ms] Remote-Containers 0.200.0 in VS Code 1.61.0-insider (8d30d4d922dda917d22f05a81f2ab4fad7349779).
[9 ms] Start: Run: wsl -l -v
[82 ms] Start: Run: wsl -d Ubuntu -e wslpath -u C:\Program Files\Microsoft VS Code Insiders
[170 ms] Start: Run: wsl -d Ubuntu
[704 ms] Start: Run: wsl -l -v
[722 ms] Start: Resolving Remote
[723 ms] Start: Run: wsl -l -v
[739 ms] Start: Run: wsl -d Ubuntu -e wslpath -u C:\Program Files\Microsoft VS Code Insiders
[762 ms] Start: Run: wsl -d Ubuntu -e wslpath -u C:\Program Files\Microsoft VS Code Insiders
[826 ms] Start: Run: wsl -d Ubuntu
[859 ms] Start: Run: wsl -d Ubuntu
[955 ms] Start: Check Docker is running
[955 ms] Start: Run: wsl -d Ubuntu -e /bin/sh -c cd '/mnt/c/Program Files/Microsoft VS Code Insiders' && DISPLAY='1' ELECTRON_RUN_AS_NODE='1' SSH_ASKPASS='c:\Users\max06\.vscode-insiders\extensions\ms-vscode-remote.remote-containers-0.200.0\scripts\ssh-askpass.bat' VSCODE_SSH_ASKPASS_NODE='C:\Program Files\Microsoft VS Code Insiders\Code - Insiders.exe' VSCODE_SSH_ASKPASS_MAIN='c:\Users\max06\.vscode-insiders\extensions\ms-vscode-remote.remote-containers-0.200.0\dist\common\sshAskpass.js' VSCODE_SSH_ASKPASS_HANDLE='\\.\pipe\ssh-askpass-2054f9a6bb0f0495bbcdecd5d3de1497ca0dcab4-sock' DOCKER_CONTEXT='default' VSCODE_SSH_ASKPASS_COUNTER='2' podman 'version' '--format' '{{.Server.APIVersion}}'
[2222 ms] Server API version: 3.2.3
[2224 ms] Start: Run: wsl -d Ubuntu -e /bin/sh -c cd '/mnt/c/Program Files/Microsoft VS Code Insiders' && DISPLAY='1' ELECTRON_RUN_AS_NODE='1' SSH_ASKPASS='c:\Users\max06\.vscode-insiders\extensions\ms-vscode-remote.remote-containers-0.200.0\scripts\ssh-askpass.bat' VSCODE_SSH_ASKPASS_NODE='C:\Program Files\Microsoft VS Code Insiders\Code - Insiders.exe' VSCODE_SSH_ASKPASS_MAIN='c:\Users\max06\.vscode-insiders\extensions\ms-vscode-remote.remote-containers-0.200.0\dist\common\sshAskpass.js' VSCODE_SSH_ASKPASS_HANDLE='\\.\pipe\ssh-askpass-2054f9a6bb0f0495bbcdecd5d3de1497ca0dcab4-sock' DOCKER_CONTEXT='default' VSCODE_SSH_ASKPASS_COUNTER='3' podman 'ps' '-q' '-a' '--filter' 'label=vsch.local.volume=gecio.github.io-0a70596414ae77f869d89a5c22377ec6' '--filter' 'label=vsch.quality=insider'
[3354 ms] Start: Run: wsl -d Ubuntu -e /bin/sh -c cd '/mnt/c/Program Files/Microsoft VS Code Insiders' && DISPLAY='1' ELECTRON_RUN_AS_NODE='1' SSH_ASKPASS='c:\Users\max06\.vscode-insiders\extensions\ms-vscode-remote.remote-containers-0.200.0\scripts\ssh-askpass.bat' VSCODE_SSH_ASKPASS_NODE='C:\Program Files\Microsoft VS Code Insiders\Code - Insiders.exe' VSCODE_SSH_ASKPASS_MAIN='c:\Users\max06\.vscode-insiders\extensions\ms-vscode-remote.remote-containers-0.200.0\dist\common\sshAskpass.js' VSCODE_SSH_ASKPASS_HANDLE='\\.\pipe\ssh-askpass-2054f9a6bb0f0495bbcdecd5d3de1497ca0dcab4-sock' DOCKER_CONTEXT='default' VSCODE_SSH_ASKPASS_COUNTER='4' podman 'build' '-f' '/tmp/vsch/volumeInspect.Dockerfile-0.200.0' '-t' 'vsc-volume-inspect' '/tmp/vsch'
STEP 1: FROM alpine:3.11.2
Resolved "alpine" as an alias (/etc/containers/registries.conf.d/000-shortnames.conf)
Trying to pull docker.io/library/alpine:3.11.2...
Getting image source signatures
Copying blob sha256:e6b0cf9c0882fb079c9d35361d12ff4691f916b6d825061247d1bd0b26d7cf3f
Copying config sha256:cc0abc535e36a7ede71978ba2bbd8159b8a5420b91f2fbc520cdf5f673640a34
Writing manifest to image destination
Storing signatures
STEP 2: RUN apk add --no-cache  nodejs  git     openssh-client  docker-cli      bash    ;
fetch http://dl-cdn.alpinelinux.org/alpine/v3.11/main/x86_64/APKINDEX.tar.gz
fetch http://dl-cdn.alpinelinux.org/alpine/v3.11/community/x86_64/APKINDEX.tar.gz
(1/18) Installing ncurses-terminfo-base (6.1_p20200118-r4)
(2/18) Installing ncurses-libs (6.1_p20200118-r4)
(3/18) Installing readline (8.0.1-r0)
(4/18) Installing bash (5.0.11-r1)
Executing bash-5.0.11-r1.post-install
(5/18) Installing ca-certificates (20191127-r2)
(6/18) Installing docker-cli (19.03.5-r1)
(7/18) Installing nghttp2-libs (1.40.0-r1)
(8/18) Installing libcurl (7.79.1-r0)
(9/18) Installing expat (2.2.9-r1)
(10/18) Installing pcre2 (10.34-r1)
(11/18) Installing git (2.24.4-r0)
(12/18) Installing c-ares (1.17.2-r0)
(13/18) Installing libgcc (9.3.0-r0)
(14/18) Installing libstdc++ (9.3.0-r0)
(15/18) Installing nodejs (12.22.6-r0)
(16/18) Installing openssh-keygen (8.1_p1-r0)
(17/18) Installing libedit (20191211.3.1-r0)
(18/18) Installing openssh-client (8.1_p1-r0)
Executing busybox-1.31.1-r8.trigger
Executing ca-certificates-20191127-r2.trigger
OK: 128 MiB in 32 packages
STEP 3: COMMIT vsc-volume-inspect
--> 58f9a7df369
Successfully tagged localhost/vsc-volume-inspect:latest
58f9a7df369661d36a5f5aae9eb31b236984ee1ce59677938357eb363eb524be
[15003 ms] Start: Run: wsl -d Ubuntu -e /bin/sh -c cd '/mnt/c/Program Files/Microsoft VS Code Insiders' && DISPLAY='1' ELECTRON_RUN_AS_NODE='1' SSH_ASKPASS='c:\Users\max06\.vscode-insiders\extensions\ms-vscode-remote.remote-containers-0.200.0\scripts\ssh-askpass.bat' VSCODE_SSH_ASKPASS_NODE='C:\Program Files\Microsoft VS Code Insiders\Code - Insiders.exe' VSCODE_SSH_ASKPASS_MAIN='c:\Users\max06\.vscode-insiders\extensions\ms-vscode-remote.remote-containers-0.200.0\dist\common\sshAskpass.js' VSCODE_SSH_ASKPASS_HANDLE='\\.\pipe\ssh-askpass-2054f9a6bb0f0495bbcdecd5d3de1497ca0dcab4-sock' DOCKER_CONTEXT='default' VSCODE_SSH_ASKPASS_COUNTER='6' podman '-v'
[15449 ms] Start: Run: wsl -d Ubuntu -e /bin/sh -c cd '/mnt/c/Program Files/Microsoft VS Code Insiders' && DISPLAY='1' ELECTRON_RUN_AS_NODE='1' SSH_ASKPASS='c:\Users\max06\.vscode-insiders\extensions\ms-vscode-remote.remote-containers-0.200.0\scripts\ssh-askpass.bat' VSCODE_SSH_ASKPASS_NODE='C:\Program Files\Microsoft VS Code Insiders\Code - Insiders.exe' VSCODE_SSH_ASKPASS_MAIN='c:\Users\max06\.vscode-insiders\extensions\ms-vscode-remote.remote-containers-0.200.0\dist\common\sshAskpass.js' VSCODE_SSH_ASKPASS_HANDLE='\\.\pipe\ssh-askpass-2054f9a6bb0f0495bbcdecd5d3de1497ca0dcab4-sock' DOCKER_CONTEXT='default' VSCODE_SSH_ASKPASS_COUNTER='5' podman 'events' '--format' 'json' '--filter' 'event=start'
[15454 ms] Start: Starting container
[15454 ms] Start: Run: wsl -d Ubuntu -e /bin/sh -c cd '/mnt/c/Program Files/Microsoft VS Code Insiders' && DISPLAY='1' ELECTRON_RUN_AS_NODE='1' SSH_ASKPASS='c:\Users\max06\.vscode-insiders\extensions\ms-vscode-remote.remote-containers-0.200.0\scripts\ssh-askpass.bat' VSCODE_SSH_ASKPASS_NODE='C:\Program Files\Microsoft VS Code Insiders\Code - Insiders.exe' VSCODE_SSH_ASKPASS_MAIN='c:\Users\max06\.vscode-insiders\extensions\ms-vscode-remote.remote-containers-0.200.0\dist\common\sshAskpass.js' VSCODE_SSH_ASKPASS_HANDLE='\\.\pipe\ssh-askpass-2054f9a6bb0f0495bbcdecd5d3de1497ca0dcab4-sock' DOCKER_CONTEXT='default' VSCODE_SSH_ASKPASS_COUNTER='8' podman 'run' '--sig-proxy=false' '-a' 'STDOUT' '-a' 'STDERR' '--mount' 'src=gecio.github.io-0a70596414ae77f869d89a5c22377ec6,dst=/workspaces,type=volume,volume-driver=local' '--mount' 'type=volume,src=vscode,dst=/vscode' '-l' 'vsch.local.volume=gecio.github.io-0a70596414ae77f869d89a5c22377ec6' '-l' 'vsch.quality=insider' '-l' 'vsch.remote.devPort=0' '--entrypoint' '/bin/sh' 'vsc-volume-inspect' '-c' 'echo Container started
Error: volume-driver: invalid mount option
[16529 ms] Start: Run: wsl -d Ubuntu -e /bin/sh -c cd '/mnt/c/Program Files/Microsoft VS Code Insiders' && DISPLAY='1' ELECTRON_RUN_AS_NODE='1' SSH_ASKPASS='c:\Users\max06\.vscode-insiders\extensions\ms-vscode-remote.remote-containers-0.200.0\scripts\ssh-askpass.bat' VSCODE_SSH_ASKPASS_NODE='C:\Program Files\Microsoft VS Code Insiders\Code - Insiders.exe' VSCODE_SSH_ASKPASS_MAIN='c:\Users\max06\.vscode-insiders\extensions\ms-vscode-remote.remote-containers-0.200.0\dist\common\sshAskpass.js' VSCODE_SSH_ASKPASS_HANDLE='\\.\pipe\ssh-askpass-2054f9a6bb0f0495bbcdecd5d3de1497ca0dcab4-sock' DOCKER_CONTEXT='default' VSCODE_SSH_ASKPASS_COUNTER='9' podman 'ps' '-q' '-a' '--filter' 'label=vsch.local.volume=gecio.github.io-0a70596414ae77f869d89a5c22377ec6' '--filter' 'label=vsch.quality=insider'
[17496 ms] Command failed: podman run --sig-proxy=false -a STDOUT -a STDERR --mount src=gecio.github.io-0a70596414ae77f869d89a5c22377ec6,dst=/workspaces,type=volume,volume-driver=local --mount type=volume,src=vscode,dst=/vscode -l vsch.local.volume=gecio.github.io-0a70596414ae77f869d89a5c22377ec6 -l vsch.quality=insider -l vsch.remote.devPort=0 --entrypoint /bin/sh vsc-volume-inspect -c echo Container started

Edit: While testing podman (remote) and setting up a new vm for docker locally, I fell across an issue regarding VPN connections. To me it looks like you're doing an initial checkout looking for a devcontainer definition on the system running the vscode client. In both of my scenarios that machine has no access to my repository server. Is there an existing workaround for this? Is this intended? Do you want/need a new issue for this?

Originally posted by @max06 in https://github.com/microsoft/vscode-remote-release/issues/5609#issuecomment-933318298