alibaba / alibaba/feathub

Support creating FeathubClient from configuration file

Open
#96 0 comments 0 reactions 0 assignees View on GitHub
type:feature
Dominant language
Python
Stars
350
Forks
60
PR merge metrics
No merged PRs in 30d

Description

In files like `nyc_example.py`, when creating a FeathubClient, apart from listing all the configuration parameters in the format of a dict variable, it should also be supported to read the configurations from a json or yaml file and create the FeathubClient from this. After that, `nyc_example.py`, `nyc_example_flink_session.py`, `nyc_example_spark_client.py` could be restructured into one python file and three configuration files with different processor configurations.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by comparing nyc_example.py, nyc_example_flink_session.py, and nyc_example_spark_client.py to identify their FeathubClient configuration differences. Trace how the client currently accepts dict parameters, then define the JSON/YAML configuration entry point; done means one Python example can use three configuration files with distinct processor settings.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
developer-experience
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.