NVIDIA / NVIDIA/cccl

Figure out S3 authentication in local Windows development

Open
#340 0 comments 0 reactions 1 assignee Claimed by @miscco View on GitHub
Dominant language
C++
Stars
2.5k
Forks
486
Avg merge
2d 6h
Merged PRs (30d)
295

Description

In our Windows containers, we would like to be able to use sccache and share the same S3 bucket used by CI.

In our Linux devcontainers, this works via custom AWS/GitHub authentication logic written by @trxcllnt. These scripts can be found here: https://github.com/rapidsai/devcontainers/tree/91d2f91a2f3328cd7af39a5fcfbacc933bbaaa1b/features/src/utils/opt/devcontainer/bin/vault/s3/creds

These are currently written in bash and so will not be directly usable in Windows.

I see 3 possible options to make the AWS/S3 authentication work on Windows:
1. Replicate the bash scripts in powershell
- This isn't ideal as it would be redundant and the two sets of scripts would diverge over time
2. Port the bash scripts to a language that will work in both Windows/Linux (Python? Javascript?)
- In theory this should work?
3. Find a way to invoke the existing bash scripts in a WSL environment on a Windows runner
- In theory, we should be able to get the credentials in WSL and use them in the native Windows environment?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.