duckdb / duckdb/duckdb-httpfs

Feature Request: Customize HF Endpoint

Open
#150 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
60
Forks
100
Avg merge
1h 50m
Merged PRs (30d)
25

Description

I'd like to request a feature that allows customization of the Hugging Face endpoint such that DuckDB can work with huggingface compatible APIs. Right now it looks like the URL is hardcoded to huggingface.co. This should be achievable using a similar pattern to the S3 compatibility via the API Secret.

For example, S3 endpoints are set via the `ENDPOINT` parameter: https://duckdb.org/docs/stable/core_extensions/httpfs/s3api#overview-of-s3-secret-parameters

Suggested API:
```
CREATE OR REPLACE SECRET secret (
TYPE huggingface,
TOKEN 'your_hf_token'
ENDPOINT 'your_custom_endpoint` # Defaults to huggingface.co
USE_SSL true # Allows http when set to false
);
```

Contributor guide

No contributing guide indexed for this repository

Research direction

No source file or test is named. Begin by locating where the Hugging Face URL is hardcoded and compare its secret handling with the S3 compatibility pattern linked in the issue; done means custom endpoints, the default endpoint, and USE_SSL behavior are supported.

Written by the indexing model from the issue text.

Assessment

Tech stack
huggingface
Domain
api
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
42/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.