apache / apache/pinot

Build a tool that can easily port data on Druid to Pinot

Open
#4,569 1 comment 11 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
6.1k
Forks
1.5k
Avg merge
2d 55m
Merged PRs (30d)
182

Description

Many clients are interested in comparing the performance between Pinot and Druid for their use cases. We have seen many cases where clients are already running Druid cluster. If we provided a tool that can easily migrate data from Druid cluster to Pinot cluster, people can compare two systems more easily and we will also be able to gain more adoption.

This will involve in implementing the following components:
1. Druid Segment Reader
2. Druid-Pinot Segment conversion tool & Hadoop job
3. Schema & Table config converter

This can be extended to a tool that automatizes the end-to-end migration process.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.