apache / apache/paimon

[Feature] add support pulsar connection in paimon

Open
#1,544 0 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Java
Stars
3.4k
Forks
1.4k
Avg merge
1d 11h
Merged PRs (30d)
396

Description

### Search before asking

- [X] I searched in the [issues](https://github.com/apache/incubator-paimon/issues) and found nothing similar.

### Motivation

I have add support pulsar connection in paimon
namely, we can use paimon for pulsar connecting with as following:

./flink run -jar paimon-flink-action-0.5-SNAPSHOT.jar **pulsar-sync-table** **--warehouse** hdfs://10.180.85.1:8020/ **--database** test_db **--table** users **--pulsar-conf pulsar.client.serviceUrl**=pulsar://10.180.85.1:31683 **--pulsar-conf pulsar.admin.adminUrl**=http://10.180.85.1:30880 **--pulsar-conf topic**=persistent://public/default/my-topic

### Solution

I have added some functional support for paimon

### Anything else?

_No response_

### Are you willing to submit a PR?

- [X] I'm willing to submit a PR!

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by locating the pulsar-sync-table entry point in paimon-flink-action and reviewing how the shown --pulsar-conf options are handled. The issue names no files or tests, so first establish the intended Pulsar connection and table-sync behavior; done means the documented command works end to end.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering, distributed-systems
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.