lance-format / lance-format/lance
Support Storage Options in Spark Connector
Open
Nobody has claimed this yet.
feature
good first issue
- Dominant language
- Rust
- Stars
- 7.1k
- Forks
- 852
- Avg merge
- 3d 18h
- Merged PRs (30d)
- 272
Description
To enable connecting to S3 with passing in storage options
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by locating the Spark connector entry point and its storage configuration handling, then trace how an S3 connection is created. Check how storage options are currently passed and identify the connector behavior needed to accept them; done means an S3 connection can be configured with storage options.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- aws, rust, spark
- Domain
- cloud, data-engineering
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 45/100