ConduitIO / ConduitIO/conduit

Feature: Ability to update pipelines provisioned by config files

Open
#1,875 6 comments 2 reactions 0 assignees View on GitHub
feature
Dominant language
Go
Stars
610
Forks
63
Avg merge
12h 28m
Merged PRs (30d)
57

Description

### Feature description

It is much easier/faster to define a pipeline file config files than to do so via the Web UI (too many clicks, and various bugs like buttons sporadically not working) or HTTP API (would require setting up scripts to run all the http requests and their varied payloads etc...). However, file configurations are immutable, so you have to restart the Conduit server in order to change them.

It would be great if we could update the config file and the changes would get reflected immediately.

I dont know what limitations there are with this compared to the HTTP API, but perhaps [fsnotify](https://github.com/fsnotify/fsnotify) could be used to monitor the `pipelines` and maybe even the `connectors` directories?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.