OpenFn / OpenFn/lightning

Kafka credential type

Open
#2,575 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Elixir
Stars
296
Forks
86
Avg merge
1d 13h
Merged PRs (30d)
50

Description

When users are setting up Kafka triggers, they have to set up the credentials directly via the workflow canvas. There are a few issues with this:

  • When using the provisioner, the credential is discarded so users have to set up the credential after every pull/deploy operation
  • two or more workflows connected to the same cluster should be able to share one credential rather then creating one for each workflow.

The proposal is to enable users to create a Kafka credential type that can be reused in one or many workflows. This credential will be selected when configuring the trigger.

A similar implementation to this proposal is the webhook authentication feature.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Review the existing webhook authentication implementation and the provisioner and workflow-canvas paths described in the issue. Define reusable Kafka credentials that survive pull/deploy operations and can be selected by multiple Kafka triggers; verify both checklist behaviors.

Written by the indexing model from the issue text.

Assessment

Tech stack
elixir, kafka
Domain
authentication, backend, stream-processing
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.