opensearch-project / opensearch-project/sql
[BUG] Poor handling of boolean expressions in WHERE clauses
Nobody has claimed this yet.
- Dominant language
- Java
- Stars
- 176
- Forks
- 229
- Avg merge
- 2d 21h
- Merged PRs (30d)
- 43
Description
What is the bug?
This is a bug for three related issues around booleans in WHERE clauses. I suspect without proof that they all have a similar root cause. All examples here use the ecommerce dataset as an example index, but should be reproducible with any index.
How can one reproduce the bug?
WHERE FALSEmatches all records.
Query:
POST _plugins/_sql/_explain
{
"query": "SELECT COUNT(*) FROM opensearch_dashboards_sample_data_ecommerce WHERE FALSE"
}
Result:
{
"schema": [
{
"name": "COUNT(*)",
"type": "integer"
}
],
"datarows": [
[
4675 // should be 0
]
],
"total": 1,
"size": 1,
"status": 200
}
WHERE NOT(x)causes an error for any constant boolean.
Query:
POST _plugins/_sql
{
"query": "SELECT * FROM opensearch_dashboards_sample_data_ecommerce WHERE NOT(FALSE)"
}
Result:
{
"error": {
"reason": "Invalid SQL query",
"details": "inner bool query clause cannot be null",
"type": "IllegalArgumentException"
},
"status": 400
}
The same happens with WHERE NOT(TRUE), WHERE NOT(NOT(FALSE)), WHERE NOT(FALSE OR TRUE), and similar.
- Internal druid exceptions raised when building expressions with
NOT(NULL).
Query:
POST _plugins/_sql
{
"query": "SELECT * FROM opensearch_dashboards_sample_data_ecommerce WHERE TRUE = NOT(NULL)"
}
Result:
{
"error": {
"reason": "Invalid SQL query",
"details": "err find condition class com.alibaba.druid.sql.ast.expr.SQLBooleanExpr",
"type": "SqlParseException"
},
"status": 400
}
NOT(NULL) is equivalent to NULL, so this whole expression should be equivalent to WHERE NULL and return no records[^1].
What is the expected behavior?
These expressions should be correctly evaluated and applied. They're somewhat weird examples for human-written queries, but automatic query builders may produce queries like this, especially for WHERE FALSE.
What is your host/environment?
- SQL: 0e61d20c
Do you have any screenshots?
N/A
Do you have any additional context?
Found by the WIP distributed-testing suite. See: #3220
[^1]: It's worth noting that SQL really uses ternary logic: NULL lives among the typical boolean values and the 3 values generate their own truth tables. This is (for better or for worse) pretty fundamental to SQL's operation and is the principle that TLP is built on. As such, in boolean handling, we should really treat NULL as a bona fide boolean.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reproducing the three cases through the _plugins/_sql and _plugins/_sql/_explain entry points, then consult the distributed-testing suite linked in the issue and #3220. Done means WHERE FALSE returns no rows, constant boolean expressions under NOT no longer error, and NOT(NULL) follows SQL ternary logic without an internal Druid exception.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java, sql
- Domain
- backend-api-design, databases
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 38/100