quickwit-oss / quickwit-oss/quickwit

Native ip / array<ip> fields don't support CIDR or wildcards

Open
#6,476 0 comments 1 reaction 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Rust
Stars
11.7k
Forks
597
Avg merge
2d 22h
Merged PRs (30d)
37

Description

Summary

Quickwit's native ip field type stores IPv4/IPv6 efficiently but the query parser rejects:

  • CIDR notation: src_ip:10.0.0.0/8 → "failed to parse query"
  • Wildcards: src_ip:10.0.* → "wildcard queries not supported on ip fields"
  • Substring patterns: src_ip:*.0.1 → same as above

Exact equality and range queries work, but there's no native network-range or partial-IP matching.

Repro

curl -sS "$QW/api/v1/<index>/search?query=source.ip:10.0.0.0/8"
# → 400, "failed to parse query"

curl -sS "$QW/api/v1/<index>/search?query=source.ip:*10.0*"
# → 400, "wildcard queries not supported on ip fields"

Expected behavior

  • CIDR (10.0.0.0/8, 2001:db8::/32) translates to the equivalent ip range internally.
  • Wildcard / prefix / substring support on ip fields — either native, or via a documented .text / .keyword multi-field convention similar to Elasticsearch's pattern.

Use case

Security event search: "all traffic from corp subnet 10.0.0.0/8" or "all IPs starting with 192.168" are extremely common. Today, the only way to support these is to maintain a parallel text-typed IP field in the ingest pipeline and route substring/CIDR operators to it — roughly doubling the storage cost of the IP column.

Version

Observed on 0.8.x.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reproducing the CIDR and wildcard requests against the search API and tracing how the query parser handles native ip fields. Compare the existing exact and range behavior with the requested CIDR and pattern cases. Done means the chosen native or documented multi-field approach supports the stated searches without breaking existing queries.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
networking, search
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
48/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.