influxdata / influxdata/influxdb

[v3] The Parquet file generation is abnormal and results in multiple files

Open
#27,357 0 comments 0 reactions 0 assignees View on GitHub
v3 v3/core
Dominant language
Rust
Stars
31.7k
Forks
3.7k
Avg merge
13h 37m
Merged PRs (30d)
8

Description

By default, Parquet should generate a file every 10 minutes, but I have observed that it has generated hundreds of files. What is the reason for this, because the data insertion is too large?

Contributor guide

Open the contributing guide

Research direction

No source file, test, or entry point is named. Start by reproducing Parquet generation with the reported insertion volume and trace the v3 path around the 10-minute rotation setting; done means identifying why hundreds of files are produced and documenting or testing the expected behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
databases
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.