Feature Request: Customize HF Endpoint
- Dominant language
- C++
- Stars
- 60
- Forks
- 100
- Avg merge
- 1h 50m
- Merged PRs (30d)
- 25
Description
I'd like to request a feature that allows customization of the Hugging Face endpoint such that DuckDB can work with huggingface compatible APIs. Right now it looks like the URL is hardcoded to huggingface.co. This should be achievable using a similar pattern to the S3 compatibility via the API Secret.
For example, S3 endpoints are set via the `ENDPOINT` parameter: https://duckdb.org/docs/stable/core_extensions/httpfs/s3api#overview-of-s3-secret-parameters
Suggested API:
```
CREATE OR REPLACE SECRET secret (
TYPE huggingface,
TOKEN 'your_hf_token'
ENDPOINT 'your_custom_endpoint` # Defaults to huggingface.co
USE_SSL true # Allows http when set to false
);
```
Contributor guide
No contributing guide indexed for this repository
Research direction
No source file or test is named. Begin by locating where the Hugging Face URL is hardcoded and compare its secret handling with the S3 compatibility pattern linked in the issue; done means custom endpoints, the default endpoint, and USE_SSL behavior are supported.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- huggingface
- Domain
- api
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 42/100