Ssh-agent SSH_AUTH_SOCK dies silently on devcontainer on remote linux host

Version: 1.105.1 (Universal)
Commit: 7d842fb85a0275a4a8e4d7e040d2625abbf7f084
Date: 2025-10-14T22:33:36.618Z (1 day ago)
Electron: 37.6.0
ElectronBuildId: 12502201
Chromium: 138.0.7204.251
Node.js: 22.19.0
V8: 13.8.258.32-electron.0
OS: Darwin arm64 25.0.0

• Remote Extension/Connection Type: Dev Containers/WSL/Remote - Tunnels/VS Code Server
  This might be a Remote-SSH issue, but it only happens with DevContainer.

• Logs:

From Host Output:

[16:33:43.900] Log Level: 2
[16:33:43.912] VS Code version: 1.105.1
[16:33:43.912] Remote-SSH version: remote-ssh@0.120.0
[16:33:43.912] darwin arm64
[16:33:43.914] SSH Resolver called for "ssh-remote+d", attempt 1
[16:33:43.916] remote.SSH.useLocalServer = true
[16:33:43.916] remote.SSH.useExecServer = true
[16:33:43.916] remote.SSH.bindHost = {}
[16:33:43.916] remote.SSH.path = undefined
[16:33:43.916] remote.SSH.configFile = undefined
[16:33:43.916] remote.SSH.useFlock = true
[16:33:43.916] remote.SSH.lockfilesInTmp = false
[16:33:43.916] remote.SSH.localServerDownload = auto
[16:33:43.917] remote.SSH.remoteServerListenOnSocket = false
[16:33:43.917] remote.SSH.defaultExtensions = []
[16:33:43.917] remote.SSH.defaultExtensionsIfInstalledLocally = []
[16:33:43.917] remote.SSH.loglevel = 2
[16:33:43.917] remote.SSH.enableDynamicForwarding = true
[16:33:43.917] remote.SSH.enableRemoteCommand = false
[16:33:43.917] remote.SSH.serverPickPortsFromRange = {}
[16:33:43.917] remote.SSH.serverInstallPath = {}
[16:33:43.917] remote.SSH.permitPtyAllocation = false
[16:33:43.918] remote.SSH.preferredLocalPortRange = undefined
[16:33:43.918] remote.SSH.useCurlAndWgetConfigurationFiles = false
[16:33:43.918] remote.SSH.experimental.chat = false
[16:33:43.918] remote.SSH.experimental.enhancedSessionLogs = false
[16:33:43.919] remote.SSH.httpProxy = {}
[16:33:43.919] remote.SSH.httpsProxy = {}
[16:33:43.925] SSH Resolver called for host: d
[16:33:43.925] Setting up SSH remote "d"
[16:33:43.933] Acquiring local install lock: /var/folders/6m/sdtj_6yj78vfyrw9bdzvnttc0000gn/T/vscode-remote-ssh-e10c2473-install.lock
[16:33:43.934] Looking for existing server data file at /Users/ben.mullin/Library/Application Support/Code/User/globalStorage/ms-vscode-remote.remote-ssh/vscode-ssh-host-e10c2473-7d842fb85a0275a4a8e4d7e040d2625abbf7f084-0.120.0-es/data.json
[16:33:43.934] Found existing data file
[16:33:43.934] Found local server running: {"remoteListeningOn":{"port":41265},"osReleaseId":"ubuntu","arch":"x86_64","sshAuthSock":"/tmp/ssh-XXXXOUBwid/agent.4071003","display":"","tmpDir":"/run/user/1001","platform":"linux","execServerToken":"30103840-58db-43e1-b485-a94eb02871bb","pid":14603,"ipcHandlePath":"/var/folders/6m/sdtj_6yj78vfyrw9bdzvnttc0000gn/T/vscode-ssh-askpass-a5e2726cf88823ec84d53bf4f854a60213cc9f21.sock","socksPort":63556,"startupTime":1760571216013}
[16:33:43.938] Found running server - short-circuiting install
[16:33:43.940] Starting forwarding server. local port 63576 -> socksPort 63556 -> remotePort 41265
[16:33:43.940] Forwarding server listening on port 63576
[16:33:43.940] Waiting for ssh tunnel to be ready
[16:33:43.940] Tunneled port 41265 to local port 63576
[16:33:43.940] Resolved "ssh-remote+d" to "port 63576"
[16:33:43.944] Initizing new exec server for ssh-remote+d
[16:33:43.944] Resolving exec server at port 63576
[16:33:43.944] [Forwarding server port 63576] Got connection 0
[16:33:43.945] [Forwarding server port 63576] Got connection 1
[16:33:44.041] Exec server for ssh-remote+d created and cached
[16:33:44.041] Extensions to install: 
[16:33:44.041] Updating $SSH_AUTH_SOCK: ln -f -s "/tmp/ssh-XXXXOUBwid/agent.4071003" "/run/user/1001/vscode-ssh-auth-sock-243591993"
[16:33:44.041] Using cwd: vscode-remote://ssh-remote%2Bd/
[16:33:44.042] Remote extension host environment: {"SSH_AUTH_SOCK":"/run/user/1001/vscode-ssh-auth-sock-243591993"}
[16:33:44.044] ------




[16:33:44.045] No hints found in the recent session.
[16:33:44.114] [server] Checking /home/ben.mullin/.vscode-server/cli/servers/Stable-7d842fb85a0275a4a8e4d7e040d2625abbf7f084/log.txt and /home/ben.mullin/.vscode-server/cli/servers/Stable-7d842fb85a0275a4a8e4d7e040d2625abbf7f084/pid.txt for a running server...
[16:33:44.166] [server] Installing and setting up Visual Studio Code Server...
[16:33:44.255] [server] Downloading Visual Studio Code server -> /tmp/.tmp0Jt7lO/vscode-server-linux-x64.tar.gz
[16:33:44.255] [server] server download progress: 0/71734997 (0%)
[16:33:44.307] [server] server download progress: 2105344/71734997 (3%)
[16:33:44.315] [server] server download progress: 4210688/71734997 (6%)
[16:33:44.325] [server] server download progress: 6316032/71734997 (9%)
[16:33:44.339] [server] server download progress: 8421376/71734997 (12%)
[16:33:44.349] [server] server download progress: 10526720/71734997 (15%)
[16:33:44.355] [server] server download progress: 12632064/71734997 (18%)
[16:33:44.364] [server] server download progress: 14737408/71734997 (21%)
[16:33:44.373] [server] server download progress: 16838752/71734997 (23%)
[16:33:44.382] [server] server download progress: 18936734/71734997 (26%)
[16:33:44.392] [server] server download progress: 21035753/71734997 (29%)
[16:33:44.401] [server] server download progress: 23139329/71734997 (32%)
[16:33:44.412] [server] server download progress: 25238809/71734997 (35%)
[16:33:44.422] [server] server download progress: 27343784/71734997 (38%)
[16:33:44.431] [server] server download progress: 29446473/71734997 (41%)
[16:33:44.440] [server] server download progress: 31545953/71734997 (44%)
[16:33:44.452] [server] server download progress: 33643992/71734997 (47%)
[16:33:44.465] [server] server download progress: 35745800/71734997 (50%)
[16:33:44.473] [server] server download progress: 37845280/71734997 (53%)
[16:33:44.482] [server] server download progress: 39944009/71734997 (56%)
[16:33:44.491] [server] server download progress: 42049254/71734997 (59%)
[16:33:44.501] [server] server download progress: 44146570/71734997 (62%)
[16:33:44.511] [server] server download progress: 46250081/71734997 (64%)
[16:33:44.520] [server] server download progress: 48354408/71734997 (67%)
[16:33:44.529] [server] server download progress: 50452642/71734997 (70%)
[16:33:44.538] [server] server download progress: 52556153/71734997 (73%)
[16:33:44.547] [server] server download progress: 54656944/71734997 (76%)
[16:33:44.560] [server] server download progress: 56760977/71734997 (79%)
[16:33:44.573] [server] server download progress: 58865065/71734997 (82%)
[16:33:44.586] [server] server download progress: 60964545/71734997 (85%)
[16:33:44.596] [server] server download progress: 63062457/71734997 (88%)
[16:33:44.608] [server] server download progress: 65159648/71734997 (91%)
[16:33:44.622] [server] server download progress: 67263681/71734997 (94%)
[16:33:44.631] [server] server download progress: 69366001/71734997 (97%)
[16:33:44.645] [server] server download progress: 71466157/71734997 (100%)
[16:33:44.647] [server] server download progress: 71734997/71734997 (100%)
[16:33:45.550] [server] server inflate progress: 114/2265 (5%)
[16:33:45.572] [server] server inflate progress: 229/2265 (10%)
[16:33:45.591] [server] server inflate progress: 344/2265 (15%)
[16:33:45.611] [server] server inflate progress: 459/2265 (20%)
[16:33:45.650] [server] server inflate progress: 574/2265 (25%)
[16:33:45.706] [server] server inflate progress: 689/2265 (30%)
[16:33:46.359] [server] server inflate progress: 804/2265 (35%)
[16:33:46.365] [server] server inflate progress: 919/2265 (41%)
[16:33:46.368] [server] server inflate progress: 1034/2265 (46%)
[16:33:46.374] [server] server inflate progress: 1149/2265 (51%)
[16:33:46.386] [server] server inflate progress: 1264/2265 (56%)
[16:33:46.402] [server] server inflate progress: 1379/2265 (61%)
[16:33:46.418] [server] server inflate progress: 1494/2265 (66%)
[16:33:46.560] [server] server inflate progress: 1609/2265 (71%)
[16:33:46.566] [server] server inflate progress: 1724/2265 (76%)
[16:33:46.572] [server] server inflate progress: 1839/2265 (81%)
[16:33:46.616] [server] server inflate progress: 1954/2265 (86%)
[16:33:46.636] [server] server inflate progress: 2069/2265 (91%)
[16:33:46.654] [server] server inflate progress: 2184/2265 (96%)
[16:33:46.664] [server] server inflate progress: 2265/2265 (100%)
[16:33:46.925] [server] Server integrity verified, version: 1.105.1 / 7d842fb85a0275a4a8e4d7e040d2625abbf7f084 / x64 / 
[16:33:46.988] [server] Server setup complete
[16:33:46.988] [server] Starting server...
[16:33:46.989] [server] Starting server with command... Command { std: "/home/ben.mullin/.vscode-server/cli/servers/Stable-7d842fb85a0275a4a8e4d7e040d2625abbf7f084/server/bin/code-server" "--connection-token=remotessh" "--accept-server-license-terms" "--start-server" "--enable-remote-auto-shutdown" "--socket-path=/tmp/code-d0fd2e91-ed82-46dd-8394-87ac5cde31c3", kill_on_drop: false }
[16:33:47.158] [server] *
[16:33:47.158] [server] * Visual Studio Code Server
[16:33:47.158] [server] *
[16:33:47.158] [server] * By using the software, you agree to
[16:33:47.158] [server] * the Visual Studio Code Server License Terms (https://aka.ms/vscode-server-license) and
[16:33:47.158] [server] * the Microsoft Privacy Statement (https://privacy.microsoft.com/en-US/privacystatement).
[16:33:47.158] [server] *
[16:33:47.160] [server] Server bound to /tmp/code-d0fd2e91-ed82-46dd-8394-87ac5cde31c3
[16:33:47.160] [server] Extension host agent listening on /tmp/code-d0fd2e91-ed82-46dd-8394-87ac5cde31c3
[16:33:47.161] [server] parsed location: "/tmp/code-d0fd2e91-ed82-46dd-8394-87ac5cde31c3"
[16:33:47.161] [server] 
[16:33:47.246] [server] [23:33:47] 
[16:33:47.287] [server] 
[16:33:47.287] [server] 
[16:33:47.287] [server] 
[16:33:47.287] [server] 
[16:33:47.320] [server] [23:33:47] Extension host agent started.
[16:33:47.453] [server] [23:33:47] [<unknown>][087c0c76][ManagementConnection] New connection established.
[16:33:47.484] [server] [23:33:47] [<unknown>][b1eb1b22][ExtensionHostConnection] New connection established.
[16:33:47.936] [server] [23:33:47] [<unknown>][b1eb1b22][ExtensionHostConnection] <4076536> Launched Extension Host Process.
[16:33:48.752] "Update SSH_AUTH_SOCK" terminal command done
[16:33:49.254] Opening exec server for ssh-remote+d
[16:33:49.293] Verified and reusing cached exec server for ssh-remote+d
[16:33:49.293] No hints found in the recent session.
[16:33:49.333] [server] [23:33:49] Extensions added from another source redhat.vscode-yaml file:///home/ben.mullin/.vscode-server/extensions/extensions.json
[16:33:49.334] Opening exec server for ssh-remote+d
[16:33:49.370] Verified and reusing cached exec server for ssh-remote+d
[16:33:49.370] No hints found in the recent session.
[16:33:50.209] [server] [23:33:50] Extensions added from another source ms-python.vscode-python-envs file:///home/ben.mullin/.vscode-server/extensions/extensions.json
[16:33:51.076] [server] [23:33:51] Extensions added from another source golang.go file:///home/ben.mullin/.vscode-server/extensions/extensions.json
[16:33:51.343] [server] [23:33:51] Extensions added from another source ms-kubernetes-tools.vscode-kubernetes-tools file:///home/ben.mullin/.vscode-server/extensions/extensions.json
[16:33:52.153] [server] [23:33:52] Extensions added from another source hashicorp.terraform file:///home/ben.mullin/.vscode-server/extensions/extensions.json
[16:33:52.600] [server] [23:33:52] Extensions added from another source ms-python.debugpy file:///home/ben.mullin/.vscode-server/extensions/extensions.json
[16:33:56.347] [server] [23:33:56] Extensions added from another source ms-python.python file:///home/ben.mullin/.vscode-server/extensions/extensions.json
[16:33:56.760] [server] [23:33:56] Extensions added from another source bazelbuild.vscode-bazel file:///home/ben.mullin/.vscode-server/extensions/extensions.json
[16:33:57.339] [server] [23:33:57] Extensions added from another source ms-vscode.cpptools file:///home/ben.mullin/.vscode-server/extensions/extensions.json
[16:33:59.923] [server] [23:33:59] Extensions added from another source ms-python.vscode-pylance file:///home/ben.mullin/.vscode-server/extensions/extensions.json

<<CLOSE LAPTOP WALK TO NEXT WIRELESS AP>>


[16:36:10.124] Server delay-shutdown request failed: connect ENOENT /var/folders/6m/sdtj_6yj78vfyrw9bdzvnttc0000gn/T/vscode-ssh-askpass-a5e2726cf88823ec84d53bf4f854a60213cc9f21.sock
[16:36:10.126] Exec server for ssh-remote+d closed (gracefully)
[16:36:10.131] ------




[16:36:10.131] SSH Resolver called for "ssh-remote+d", attempt 2, (Reconnection)
[16:36:10.138] SSH Resolver called for host: d
[16:36:10.138] Setting up SSH remote "d"
[16:36:10.139] Acquiring local install lock: /var/folders/6m/sdtj_6yj78vfyrw9bdzvnttc0000gn/T/vscode-remote-ssh-e10c2473-install.lock
[16:36:11.644] Starting to look for password prompt from another window
[16:36:12.152] Looking for existing server data file at /Users/ben.mullin/Library/Application Support/Code/User/globalStorage/ms-vscode-remote.remote-ssh/vscode-ssh-host-e10c2473-7d842fb85a0275a4a8e4d7e040d2625abbf7f084-0.120.0-es/data.json
[16:36:12.153] Found existing data file
[16:36:12.153] Found local server running: {"remoteListeningOn":{"port":45749},"osReleaseId":"ubuntu","arch":"x86_64","sshAuthSock":"/tmp/ssh-XXXXSXkHRr/agent.4087503","display":"","tmpDir":"/run/user/1001","platform":"linux","execServerToken":"4ec13f6b-5764-4864-97b9-06a2b13ce648","pid":15196,"ipcHandlePath":"/var/folders/6m/sdtj_6yj78vfyrw9bdzvnttc0000gn/T/vscode-ssh-askpass-271d0fde87743509d11151f72a9524756ff28140.sock","socksPort":63660,"startupTime":1760571370148}
[16:36:12.154] Found running server - short-circuiting install
[16:36:12.156] Starting forwarding server. local port 63682 -> socksPort 63660 -> remotePort 45749
[16:36:12.156] Forwarding server listening on port 63682
[16:36:12.156] Waiting for ssh tunnel to be ready
[16:36:12.157] Tunneled port 45749 to local port 63682
[16:36:12.157] Resolved "ssh-remote+d" to "port 63682"
[16:36:12.157] Initizing new exec server for ssh-remote+d
[16:36:12.157] Resolving exec server at port 63682
[16:36:12.158] [Forwarding server port 63682] Got connection 0
[16:36:12.158] [Forwarding server port 63682] Got connection 1
[16:36:12.367] Exec server for ssh-remote+d created and cached
[16:36:12.367] Extensions to install: 
[16:36:12.368] Updating $SSH_AUTH_SOCK: ln -f -s "/tmp/ssh-XXXXSXkHRr/agent.4087503" "/run/user/1001/vscode-ssh-auth-sock-243591993"
[16:36:12.368] Using cwd: vscode-remote://ssh-remote%2Bd/
[16:36:12.368] Remote extension host environment: {"SSH_AUTH_SOCK":"/run/user/1001/vscode-ssh-auth-sock-243591993"}
[16:36:12.370] ------




[16:36:12.371] No hints found in the recent session.
[16:36:12.440] [server] Checking /home/ben.mullin/.vscode-server/cli/servers/Stable-7d842fb85a0275a4a8e4d7e040d2625abbf7f084/log.txt and /home/ben.mullin/.vscode-server/cli/servers/Stable-7d842fb85a0275a4a8e4d7e040d2625abbf7f084/pid.txt for a running server...
[16:36:12.441] [server] Found running server (pid=4075418)
[16:36:13.408] "Update SSH_AUTH_SOCK" terminal command done

From devcontainer terminal:

dev@2b867f641936:~/$ ssh -p 19418 ben.mullin@<TRNC>.com gerrit version
gerrit version 3.10.6
<<CLOSE LAPTOP WALK TO NEXT WIRELESS AP>>
dev@2b867f641936:~/$ ssh -p 19418 ben.mullin@<TRNC>.com gerrit version
ben.mullin@<TRNC>.com: Permission denied (publickey).
dev@2b867f641936:~/$ date
Wed Oct 15 11:36:59 PM UTC 2025

Steps to Reproduce:

1. connect to docker devcontainer running on remote Ubuntu host.
2. verify in terminal that you can use ssh-agent for keys forwarded from your local machine.
3. close laptop, reconnect on new wireless access point (meraki office network)
4. run same ssh verification step, results in permission issue
5. do the above test with "remote.SSH.useLocalServer": false, kill all vscode servers on remote host, delete .vscode_server folder on host, there is no ssh permission issue.

Does this issue occur when you try this locally?: Yes
Does this issue occur when you try this locally and all extensions are disabled?: DevContainer and Remote-SSH are extensions, so not sure how to test this one.