influxdata / influxdata/influxdb

Add per-query memory pool configuration

Open
#26,460 0 comments 0 reactions 0 assignees View on GitHub
v3
Dominant language
Rust
Stars
31.7k
Forks
3.7k
Avg merge
13h 37m
Merged PRs (30d)
8

Description

### Problem

https://github.com/influxdata/influxdb/pull/26429 introduced a new feature available to the query `Executor` configuration that is used for the underlying `iox_query` engine: `per_query_mem_pool_config`.

This uses the [`PerQueryMemoryPoolConfig` type](https://github.com/influxdata/influxdb3_core/blob/fd0e474a6c0af5ba867399d753f5df18f59907cb/iox_query/src/memory_pool.rs#L81-L119).

We are currently not leveraging this feature.

### Proposed solution

Add a `--per-query-memory-pool-size` CLI argument to the `serve` command that allows a user to optionally set the size of the per query memory pool.

Contributor guide

Open the contributing guide

Research direction

Start by reading PR #26429 and the PerQueryMemoryPoolConfig definition in iox_query/src/memory_pool.rs, then trace how the serve command builds its query Executor configuration. Add the optional --per-query-memory-pool-size setting and verify that its value reaches the per-query memory pool configuration.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
cli, databases
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
48/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.