matrixorigin / matrixorigin/matrixone

[Enhancement]: Scale number of log service per dn

Open
#7,065 0 comments 0 reactions 1 assignee Assigned to @XuPeng-SH View on GitHub
kind/tech-request long-term-job perf/tp priority/p1 source/dev
Dominant language
Go
Stars
1.9k
Forks
311
Avg merge
1d 3h
Merged PRs (30d)
768

Description

### Is there an existing issue for enhancement?

- [X] I have checked the existing issues.

### What would you like to be added ?

```Markdown
Right now for DN we will have one raft group (3 replicas). We should
consider scale out number of raft groups per DN.

Not clear what is a good partition scheme. Maybe we hash on database
id.
```

### Why is this needed ?

For a powerful DN instance we do not want raft/log to become scale bottleneck.

If partition by db, potentially we have a faster recovery time if DN fails

### Additional information

_No response_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.