influxdata / influxdata/influxdb

delete terribly slow : InfluxDB v2.x

Open
#23,974 8 comments 6 reactions 0 assignees View on GitHub
Dominant language
Rust
Stars
31.7k
Forks
3.7k
Avg merge
13h 37m
Merged PRs (30d)
8

Description

__Steps to reproduce:__
![image](https://user-images.githubusercontent.com/37362789/206640529-557ea515-9215-4339-bfab-5e7a277c7c0e.png)

1. Ready for some large dataset(table reference↑)
2. Try to execute ```delete from myBucket.autogen.measurement_A where time <= '2022-11-02 23:13:00'``` at ```influx v1 shell(InfluxQL Shell 2.5.0)```
3. Restore data
4. Try to execute ```./influx delete --bucket myBucket/autogen --start 1970-01-01T00:00:00Z --stop 2022-11-02T23:13:00Z --predicate '_measurement="measurement_A"'``` at ```influx CLI 2.5.0```

__Environment info:__
16C32G
Docker / Ubuntu 22.04 / binary execute influxdb OSS v2.5.1

__similar existing bug report:__
https://github.com/influxdata/influxdb/issues/9636 This issue persists in version 2.x as well.

Is there a faster way to delete it?

Contributor guide

Open the contributing guide

Research direction

Start by reproducing the large-dataset deletion with the InfluxQL Shell and the influx CLI commands shown in the issue, using the stated Docker/Ubuntu environment. Compare their timings and investigate the existing issue 9636; done means identifying a supported faster deletion path or confirming the performance limitation with measurements.

Written by the indexing model from the issue text.

Assessment

Tech stack
docker, ubuntu
Domain
cli, databases, performance
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.