quickwit-oss / quickwit-oss/quickwit

Dynamic Mapping should not tokenize values

Open
#1,829 8 comments 0 reactions 1 assignee View on GitHub

@PSeitz is already working on this.

Since Aug 19, 2022.

bug
Dominant language
Rust
Stars
11.7k
Forks
597
Avg merge
2d 22h
Merged PRs (30d)
37

Description

I’m using dynamic mapping to ingest a JSON object with a field of an array of JSON objects. If the array element has a field with value that has -, _, #, etc. delimiters in it, e.g. a uuid, querying against this field will result in the error:

“SplitSearchError { error: \”Invalid query: The field ‘_dynamic’ does not have positions indexed\”…}”

Steps to reproduce (if applicable)
Steps to reproduce the behavior:

  1. Set up index config to use dynamic mode
  2. Ingest an object with an array of objects with a field mapped to a uuid 3.
  3. Execute a term query by matching a uuid.4.

Expected behavior
I should get a matching document as a response

Configuration:
Please provide:

  1. Output of quickwit --version v0.3.1nightly
  2. The index_config.yaml
    version: 0
    index_id: foo
    doc_mapping:
    mode: dynamic
    field_mappings:
    -name: id
    type: text
    tokenizer: raw

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.