Azure MSI auth fails with adal: Refresh request failed. Status Code = '411' (MissingContentLengthHeader)
Nobody has claimed this yet.
- Dominant language
- Go
- Stars
- 23.1k
- Forks
- 1.1k
- Avg merge
- 1d 11h
- Merged PRs (30d)
- 9
Description
I think I'm doing everything right, but the encryption fails, even though it worked both when logged in via az login and also when using a service principal.
# There is only the system-assigned managed identity for this VM, but added this just in case.
$ export AZURE_CLIENT_ID="the-object-id-of-the-VM"
$ export AZURE_AD_RESOURCE="https://accessnews-sops.vault.azure.net/"
$ export MSI_ENDPOINT="http://169.254.169.254/metadata/identity/oauth2/token"
$ sops --encrypt --verbose \
--azure-kv https://accessnews-sops.vault.azure.net/keys/sops-key/VERSION test.json > test.enc.json
[CMD] DEBU[0000] Master keys available: [0xc000122ba0]
[AZKV] ERRO[0000] Encryption failed error="azure.BearerAuthorizer#WithAuthorization: Failed to refresh the Token for request to https://accessnews-sops.vault.azure.net/keys/sops-key/VERSION/encrypt?api-version=2016-10-01: StatusCode=411 -- Original Error: adal: Refresh request failed. Status Code = '411'. Response body: <?xml version=\"1.0\" encoding=\"utf-8\"?>\n<Error xmlns:xsi=\"http://www.w3.org/2001/XMLSchema-instance\" xmlns:xsd=\"http://www.w3.org/2001/XMLSchema\">\n <Code>MissingContentLengthHeader</Code>\n <Message>The Content-Length header was not specified.</Message>\n <Details></Details>\n</Error> Endpoint http://169.254.169.254/metadata/identity/oauth2/token" key=sops-key version=VERSION
Could not generate data key: [failed to encrypt new data key with master key "https://accessnews-sops.vault.azure.net/keys/sops-key/VERSION": Failed to encrypt data: azure.BearerAuthorizer#WithAuthorization: Failed to refresh the Token for request to https://accessnews-sops.vault.azure.net/keys/sops-key/VERSION/encrypt?api-version=2016-10-01: StatusCode=411 -- Original Error: adal: Refresh request failed. Status Code = '411'. Response body: <?xml version="1.0" encoding="utf-8"?>
<Error xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xsd="http://www.w3.org/2001/XMLSchema">
<Code>MissingContentLengthHeader</Code>
<Message>The Content-Length header was not specified.</Message>
<Details></Details>
</Error> Endpoint http://169.254.169.254/metadata/identity/oauth2/token]
When I run the token request manually, it works:
$ curl "http://169.254.169.254/metadata/identity/oauth2/token?api-version=2018-02-01&resource=https://accessnews-sops.vault.azure.net/" \
-H Metadata:true | jq
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 1690 100 1690 0 0 183k 0 --:--:-- --:--:-- --:--:-- 183k
{
"access_token": "...",
"client_id": "uuid",
"expires_in": "85497",
"expires_on": "1680209924",
"ext_expires_in": "86399",
"not_before": "1680123224",
"resource": "https://accessnews-sops.vault.azure.net/",
"token_type": "Bearer"
}
Wasn't sure about the format of MSI_ENDPOINT, so looked it up in Azure/go-autorest, but it matched what I used at the top. Just in case, also tried setting it to
http://169.254.169.254/metadata/identity/oauth2/token?api-version=2018-02-01http://169.254.169.254/metadata/identity/oauth2/token?api-version=2018-02-01&resource=https://accessnews-sops.vault.azure.net/
Unfortunately I'm not conversant with Go but will keep looking.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reproducing the failure with the shown sops encryption command and compare it with the working curl request to the MSI endpoint. Read the linked Azure/go-autorest autorest/adal/token.go path and trace the Azure MSI authentication entry point used by sops; done means encryption succeeds through the system-assigned managed identity without the 411 error.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- azure, go
- Domain
- authentication, cli, cloud, security
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100