crate / crate/cratedb-toolkit

CFR: `ctk cfr sys-export` stalls after 24% ...

Open
#429 8 comments 0 reactions 1 assignee Claimed by @florinutz View on GitHub
bug
Dominant language
Python
Stars
10
Forks
5
Avg merge
7d 5h
Merged PRs (30d)
7

Description

# What happened?
Running `sys-export` on a larger cluster seems to stall and make the node co-ordinating the queries _un-responsive_. Looking at the created report files it is not clear where it exactly got stuck. CTRL+C did not terminate the command, had to fire a `kill` in the shell to stop the python process.

Image

# To discuss/Implement

- [ ] THROTTELING: Think about a possible throttling, especially for clusters with a large amount of jobs, shards, ...
- [ ] TIMEOUT: set an explicit _statement timeout_ to avoid long running, blocking queries (althought not 100% whether that also works for queries on _sys tables_
- [ ] SHARDS: for troubleshooting purpose it might suffice to report the _not started_ shards, same for the sys.allocations query. In case we fancy to have to complete list of shards, this could be moved to a cli arg, where the default is to report only _not started_ shards.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.