apache / apache/hudi

Support configs to be passed in SchemaRegistryProvider to support google managed schema registry client auth

Open
#18,435 0 comments 0 reactions 0 assignees View on GitHub
type:feature
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

### Feature Description

**What the feature achieves:**
Support configs to be passed in SchemaRegistryProvider for CachedSchemaRegistryClient constructor initialization.

**Why this feature is needed:**
GCP Schema registry is compatible with confluent but it requires additional config for auth. Existing SchemaRegistryProvider have CachedSchemaRegistryClient with null config in constructor.

### User Experience

**How users will use this feature:**
- GCP users can pass properties in typedProperties for SchemaRegistryProvider with allowed prefixes to support auth.

### Hudi RFC Requirements

**RFC PR link:** (if applicable)

**Why RFC is/isn't needed:**
- Does this change public interfaces/APIs? - No
- Does this change storage format? - No
- Justification: We can support auth for gcp schema registry clients as well by this change.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by locating SchemaRegistryProvider and its CachedSchemaRegistryClient constructor initialization, then trace how typedProperties are read and filtered by allowed prefixes. Confirm the required Google-managed schema registry authentication properties from the surrounding integration and verify that they reach the client configuration without changing public interfaces.

Written by the indexing model from the issue text.

Assessment

Tech stack
google-cloud, java
Domain
authentication, data-engineering
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
52/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.