apache / apache/pulsar

Implement the newOutputMessage (just like java) in the python context

Open
#23,816 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
15.3k
Forks
3.8k
Avg merge
1d 14h
Merged PRs (30d)
160

Description

Currently the python Context object only has the publish method as option to publish messages to another topic. However this is quite problematic when using sinks in combination with python pulsar functions. Sinks (often) need a schema for every record.

Java already has the newOutputMessage method, that has record schema as function argument. it would be great if this can be added to the python context class.

Contributor guide

Open the contributing guide

Research direction

Start by comparing the Python Context.publish entry point with Java's newOutputMessage method and its record-schema argument. Confirm how sinks provide schemas and define the equivalent Python Context API; done means Python functions can create output messages with a schema for sink records.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, python
Domain
backend-api-design, distributed-systems
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.