Figure out S3 authentication in local Windows development
- Dominant language
- C++
- Stars
- 2.5k
- Forks
- 486
- Avg merge
- 2d 6h
- Merged PRs (30d)
- 295
Description
In our Windows containers, we would like to be able to use sccache and share the same S3 bucket used by CI.
In our Linux devcontainers, this works via custom AWS/GitHub authentication logic written by @trxcllnt. These scripts can be found here: https://github.com/rapidsai/devcontainers/tree/91d2f91a2f3328cd7af39a5fcfbacc933bbaaa1b/features/src/utils/opt/devcontainer/bin/vault/s3/creds
These are currently written in bash and so will not be directly usable in Windows.
I see 3 possible options to make the AWS/S3 authentication work on Windows:
1. Replicate the bash scripts in powershell
- This isn't ideal as it would be redundant and the two sets of scripts would diverge over time
2. Port the bash scripts to a language that will work in both Windows/Linux (Python? Javascript?)
- In theory this should work?
3. Find a way to invoke the existing bash scripts in a WSL environment on a Windows runner
- In theory, we should be able to get the credentials in WSL and use them in the native Windows environment?
Contributor guide
Assessment
This issue has not been assessed yet.