"The PowerShell session has terminated due to an error" when closing Visual Studio Code

System Details

System Details Output

### VSCode version: 1.55.2 3c4e3df9e89829dce27b7b5c24508306b151f30d x64

### VSCode extensions:
alefragnani.Bookmarks@13.0.4
anseki.vscode-color@0.4.5
christian-kohler.path-intellisense@2.3.0
CoenraadS.bracket-pair-colorizer@1.0.61 
Damien.autoit@1.0.5
DavidAnson.vscode-markdownlint@0.40.4
DotJoshJohnson.xml@2.5.1
euskadi31.json-pretty-printer@1.1.0
forevolve.git-extensions-for-vs-code@1.1.3
Gruntfuggly.todo-tree@0.0.213
hashicorp.terraform@2.10.1
hdg.live-html-previewer@0.3.0
jebbs.plantuml@2.14.5
KnisterPeter.vscode-github@0.30.6
mathiasfrohlich.Kotlin@1.7.1
mechatroner.rainbow-csv@1.8.1
mhcpnl.xcodestrings@1.0.0
ms-dotnettools.csharp@1.23.11
ms-mssql.mssql@1.10.1
ms-python.python@2021.4.765268190
ms-toolsai.jupyter@2021.5.745244803
ms-vscode-remote.remote-wsl@0.54.6
ms-vscode.cmake-tools@1.7.1
ms-vscode.cpptools@1.3.1
ms-vscode.powershell@2021.2.2
ms-vscode.powershell-preview@2021.4.2
msjsdiag.debugger-for-chrome@4.12.12
naco-siren.gradle-language@0.2.3
nobuhito.printcode@3.0.0
oderwat.indent-rainbow@7.5.0
platformio.platformio-ide@2.3.2
plex.vscode-protolint@0.5.1
redhat.java@0.79.0
scala-lang.scala@0.5.3
SimonSiefke.svg-preview@2.8.3
slevesque.vscode-autohotkey@0.2.2
slevesque.vscode-hexdump@1.8.1
streetsidesoftware.code-spell-checker@1.10.2
SzczepanMejer.bgscript-support@0.1.0
tht13.html-preview-vscode@0.2.5
twxs.cmake@0.0.17
TylerLeonhardt.vscode-inline-values-powershell@0.0.5
Tyriar.lorem-ipsum@1.2.0
VisualStudioExptTeam.vscodeintellicode@1.2.12
vscjava.vscode-java-debug@0.33.1
vscjava.vscode-java-dependency@0.18.3
vscjava.vscode-java-pack@0.14.0
vscjava.vscode-java-test@0.29.0
vscjava.vscode-maven@0.30.0
yzane.markdown-pdf@1.4.4
yzhang.markdown-all-in-one@3.4.0
zxh404.vscode-proto3@0.5.3


### PSES version: 2.3.0.0

### PowerShell version:

Name                           Value
----                           -----
PSVersion                      7.1.3
PSEdition                      Core
GitCommitId                    7.1.3
OS                             Microsoft Windows 10.0.18363
Platform                       Win32NT
PSCompatibleVersions           {1.0, 2.0, 3.0, 4.0…}
PSRemotingProtocolVersion      2.3
SerializationVersion           1.1.0.1
WSManStackVersion              3.0

Issue Description

When I close Visual Studio Code (using File / Exit or the X), I get

Expected Behaviour

No error should occur (esp. since VScode is being shut down)

Actual Behaviour

Error message

Attached Logs

logs20210503-1328+1329.zip

Start by reviewing the attached logs20210503-1328+1329.zip and reproducing the shutdown behavior with the listed VS Code, PowerShell extension, PSES, and Windows versions. Done means closing Visual Studio Code with File/Exit or the X no longer displays the PowerShell session termination error.