duckdb / duckdb/duckdb-httpfs

Add support for requester pays with credential_chain

Open
#100 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
60
Forks
100
Avg merge
1h 50m
Merged PRs (30d)
25

Description

DuckDB recently [added support](https://github.com/duckdb/duckdb/pull/18258) for AWS requester pays. However it only seems to work when specifying credentials using config proivider with key_id/secret:

```
CREATE OR REPLACE SECRET secret (
TYPE s3,
KEY_ID '',
SECRET '',
REGION 'us-east-1',
REQUESTER_PAYS true
);
```

But using it with credentials chain gives: `duckdb.duckdb.BinderException: Binder Error: Unknown parameter 'requester_pays' for secret type 's3' with provider 'credential_chain`
```
CREATE OR REPLACE SECRET secret (
TYPE s3,
PROVIDER credential_chain,
CHAIN config,
REQUESTER_PAYS true
);
```

This is inconvenient for using it in AWS services with task role-based credentials, where there's not an easy way to directly get explicit key_id/secret tokens.

Contributor guide

No contributing guide indexed for this repository

Research direction

Reproduce the two CREATE OR REPLACE SECRET examples and compare the accepted parameters for the config provider with those for credential_chain. Trace the S3 secret parameter handling for REQUESTER_PAYS; done means the credential_chain form accepts the option and works with task-role credentials.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, cpp, sql
Domain
authentication, cloud
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
50/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.