Support for relaxed search schema in ES compatible endpoint to support direct query from OpenSearch Dashboards

Is your feature request related to a problem? Please describe.

As of now Quickwit ES compatible endpoint is extremely strict on schema and do not allow optional fields passed to the query by OS Dashboards.

Describe the solution you'd like

Quickwit shouldn't reject queries with optional fields and should ignore them instead.

Describe alternatives you've considered

So far proxy resolve that, but solution is ugly.

Additional context

Examples of OSD queries here

Errors list:

• .version unknown field version, expected one of ...
• .script_fields unknown field script_fields, expected one of ...
• .docvalue_fields unknown field docvalue_fields, expected one of ...
• ._source unknown field _source, expected one of ...
• .highlight unknown field highlight, expected one o
• .query.bool.filter[].range.<>.format OneOrMany could not deserialize any variant:\n One: invalid type: sequence, expected string or map\n Many: unknown field format, expected one of gt, gte, lt, lte, boost
• .aggs.2.date_histogram.calendar_interval tantivy error: An invalid argument was passed: 'calendar_interval parameter "1m" in date histogram is unsupported, only fixed_interval is supported'
  • simple replace to fixed_interval at proxy fixes it
  • https://github.com/quickwit-oss/tantivy/issues/2037
  • https://github.com/quickwit-oss/tantivy/issues/1952

Start at the ES-compatible endpoint handling the OpenSearch Dashboards queries and compare its validation behavior with the linked proxy and example requests. Define the supported optional fields and confirm that unsupported optional fields are ignored without changing valid query results, including the listed range and date-histogram cases.