apache / apache/pulsar

[WIP]PIP-?: Revised Partitioned topic

Open
#19,099 1 comment 0 reactions 1 assignee Claimed by @mattisonchao View on GitHub
Stale type/PIP
Dominant language
Java
Stars
15.3k
Forks
3.8k
Avg merge
1d 14h
Merged PRs (30d)
160

Description

## Motivation

Very early on, Apache Pulsar introduced partition topic, But It does not have an associated PIP that defines its definition and behaviour. this involves some problems.

E.g.:
- user can use `-partitioned-` keyword to create an independent topic, which will introduce another complexity for the partitioned topic.
- user can still create a persistent topic `partition` even if the partition index is greater than the partitioned topic metadata defined.
- ...

## Goal

Provides the clarified partitioned topic definition and fixes the inappropriate part.

## Definition

### What is the partitioned topic?

Before we introduce the partitioned topic, it's better to know the topic name format first. Let's start with the non-partitioned topic(normal topic).

image

- **Topic Domain:**
- **Tenant:**
- **Namespace:**
- **Local Name:**

Next, it's the partitioned topic naming format.

image

- **`-partition-` keyword:**
- **Partition index:**

If we create a topic with four partitions, that will be looks like this:

image

### What does a partitioned topic mean for the broker and client?

image

### How to create the partitioned topic.

#### Auto-creation

#### Management API

### How to scale partitioned numbers.

### How to delete partitioned topic

### Inactive policy

### Management API

### Replication of partitioned topic

### Dead letter queue for the partitioned topic.

## Inappropriate Implementation

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.