apache / apache/iceberg-rust

Support configuring datafusion catalog in sqllogictest framework

Open
#1,780 3 comments 2 reactions 0 assignees View on GitHub
enhancement good first issue
Dominant language
Rust
Stars
1.4k
Forks
567
Avg merge
2d 2h
Merged PRs (30d)
93

Description

### Is your feature request related to a problem or challenge?

In #1764, the datafusion engine `create_catalog` is hard coded to be creating memory catalog. This limits the catalog used for the testing and does not work for scenarios with multiple engines using the same catalog.

### Describe the solution you'd like

Define a [catalog] table in schedule file. Parse the catalog table in schedule and pass the catalog created to the engine.

### Willingness to contribute

I can contribute to this feature independently

Contributor guide

Open the contributing guide

Research direction

Start by locating the sqllogictest schedule-file parser and the DataFusion engine path referenced in #1764, where create_catalog currently creates a memory catalog. Trace how schedule configuration reaches the engine, then define the catalog table format, parse it, and pass the resulting catalog through; done means catalog-backed tests can use a configured shared catalog, including multiple engines.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust, sql
Domain
databases, testing
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
55/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.