apache / apache/pulsar

Pulsar sink is not running ( sink status : false )

Open
#13,021 11 comments 0 reactions 0 assignees View on GitHub
help wanted lifecycle/stale Stale type/bug
Dominant language
Java
Stars
15.3k
Forks
3.8k
Avg merge
1d 14h
Merged PRs (30d)
160

Description

Hi ,
I created a JDBC sink connector to persist the messages from pulsar topic to postgresql database . I am running latest version of pulsar through docker .

Followed this document : https://pulsar.apache.org/docs/en/io-quickstart/#create-a-jdbc-sink

This command is to create a sink :
$ bin/pulsar-admin sinks create \
--archive ./connectors/pulsar-io-jdbc-postgres-2.8.1.nar \
--inputs my-topic \
--name jdbc-postgres-sink \
--sink-config-file ./connectors/pulsar-postgres-jdbc-sink.yaml \
--parallelism 1

This is my yaml (pulsar-postgres-jdbc-sink.yaml) file content :

tenant: "public"
namespace: "default"
name: "jdbc-postgres-sink"
topicName: "persistent://public/default/my-topic"
sinkType: "jdbc-postgres"
configs:
userName: "postgres"
password: "password"
jdbcUrl: "jdbc:postgresql://localhost:5432/pulsar_postgres_jdbc_sink"
tableName: "pulsar_postgres

After creation of sink , i didn't see any data inside postgre database and the sink running status is "false" .
Please help on the same . Thanks !!!


![sink-status](https://user-images.githubusercontent.com/71866730/143856270-b2f1b8d5-ec1b-492e-a749-5ab382d3d596.PNG)

Contributor guide

Open the contributing guide

Research direction

Start with the Pulsar JDBC sink quickstart and the supplied pulsar-postgres-jdbc-sink.yaml, then reproduce the issue using the shown pulsar-admin sinks create command in the Docker setup. Check the sink status and PostgreSQL database after creation; done means the sink reports running and messages from my-topic are persisted.

Written by the indexing model from the issue text.

Assessment

Tech stack
docker, java, postgresql
Domain
databases, distributed-systems
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.