apache / apache/gluten

[VL] Spark 4.1: Diagnose and enable TODO SQL query test files

Open
#11,916 0 comments 0 reactions 0 assignees View on GitHub
bug
Dominant language
Scala
Stars
1.6k
Forks
657
Avg merge
2d 21h
Merged PRs (30d)
85

Description

## Backend
VL (Velox)

## Bug description

11 SQL query test files are commented out as TODO in spark41 `VeloxSQLQueryTestSettings`. Each file needs to be diagnosed and either fixed directly or triaged to an existing issue by root cause.

This is a diagnostic/triage issue. Files will be routed to their root cause issues after diagnosis.

Spark 4.1 only.

Parent issue: #11550

### TODO files

| .sql file | spark40 | spark41 | Likely root cause |
|-----------|:-------:|:-------:|-------------------|
| cast.sql | 🟢 | TODO | TimeType or ANSI |
| describe.sql | 🟢 | TODO | Schema changes |
| literals.sql | 🟢 | TODO | TimeType |
| nonansi/cast.sql | 🟢 | TODO | ANSI differences (→ #10134) |
| nonansi/literals.sql | 🟢 | TODO | TimeType |
| subquery/.../exists-orderby-limit.sql | 🟢 | TODO | Plan changes |
| nonansi/st-functions.sql | N/A | TODO | Needs diagnosis |
| scripting/randomly_generated_scripts.sql | N/A | TODO | Needs diagnosis |
| st-functions.sql | N/A | TODO | Needs diagnosis |
| type-coercion-edge-cases.sql | N/A | TODO | Needs diagnosis |
| variant-field-extractions.sql | N/A | TODO | Variant (→ #11371) |

### Completion criteria

This issue can be closed when all 11 .sql files are either:
- Directly fixed and enabled, or
- Triaged to an existing issue (e.g., TimeType, Variant → #11371, ANSI → #10134) with a comment explaining the assignment.

Contributor guide

Open the contributing guide

Research direction

Start with the Spark 4.1 VeloxSQLQueryTestSettings entries and the 11 listed TODO SQL files, comparing their Spark 4.0 status where available. Diagnose each file, then either fix and enable it or assign it to an existing root-cause issue with a comment. Done means all 11 files are enabled or explicitly triaged, including the referenced TimeType, ANSI, and Variant cases.

Written by the indexing model from the issue text.

Assessment

Tech stack
scala, sql
Domain
backend, data-engineering, testing
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Clearly specified
Newbie friendliness
52/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.