baidu / baidu/tera

use TabletWriter::Thread to load/unload/split TabletIO

Open
#1,154 3 comments 0 reactions 0 assignees View on GitHub
class/enhancement module/ts stat/not-decide
Dominant language
C++
Stars
1.9k
Forks
432
PR merge metrics
No merged PRs in 30d

Description

Now we use thread_pool to load/unload/split. Because of the limit of thread number, we have to control the concurrency. So when a ts restart, the load process is very slow.
Every TabletIO has a TabletWriter, every TabletWriter has a thread. We could use that thread to do these work.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by locating the current thread_pool paths for loading, unloading, and splitting TabletIO, then read the related TabletWriter::Thread and TabletIO code. The work is complete when these operations use each TabletWriter's thread as proposed and tablet restart loading no longer depends on the limited thread-pool concurrency.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp
Domain
databases
Issue type
Refactor
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.