influxdata / influxdata/influxdb

InfluxDB 3.x Container Crashes After Multiple Queries on Large Dataset (10 Million Entries)"

Open
#26,368 5 comments 0 reactions 0 assignees View on GitHub
v3
Dominant language
Rust
Stars
31.7k
Forks
3.7k
Avg merge
13h 37m
Merged PRs (30d)
8

Description

### Bug Description

When writing a large amount of data (approximately 10 million entries) to InfluxDB 3.x, querying becomes impossible. After multiple queries, the Docker container running InfluxDB 3 crashes.

### Crash Log
```
2025-05-08T08:26:47.751159Z ERROR panic_logging: Thread panic panic_type="unknown" panic_message="byte array offset overflow" panic_file="/usr/local/cargo/git/checkouts/arrow-rs-db36434c601cf8eb/eae176c/arrow-array/src/builder/generic_bytes_builder.rs" panic_line=86 panic_column=57
```

### Steps to Reproduce

* Write approximately 10 million entries of data to InfluxDB 3.x.
* After several queries, the container crashes.

### Expected Behavior

System does not crash.

### Environment Information

* InfluxDB Version: 3.0.2-core
* Running in a Docker container.
* Docker version 26.0.2
* 8 CPU, 16 GB RAM
* Debian 12

Contributor guide

Open the contributing guide

Research direction

Start by reproducing the crash in the Docker container with approximately 10 million entries and several queries. Then inspect the reported arrow-array/src/builder/generic_bytes_builder.rs location and the surrounding query path for the byte array offset overflow. Done means repeated queries no longer crash the InfluxDB 3.0.2-core container under the reported environment.

Written by the indexing model from the issue text.

Assessment

Tech stack
docker, rust
Domain
databases
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
42/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.