apache / apache/datafusion-sqlparser-rs

fail to parse `set tez.grouping.max-size=1234;` in Hive Dialect

Open
#1,643 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Rust
Stars
3.5k
Forks
772
Avg merge
4d 9h
Merged PRs (30d)
17

Description

According to the Apache Tez code, parameter `tez.grouping.max-size` is supported.
https://github.com/apache/tez/blob/1e6c9e3448bb9d934508ee995ad60c23dafa0610/tez-mapreduce/src/main/java/org/apache/tez/mapreduce/grouper/TezSplitGrouper.java#L72
Also when hive uses tez engine, it is possible to set the `tez.grouping.max-size` parameter, but the current version fail to parse it.
![image](https://github.com/user-attachments/assets/1b7393e8-a146-4093-91a9-803d7f9d6916)

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reproducing the Hive statement `set tez.grouping.max-size=1234;` and inspect the Hive dialect parsing path. Use the Apache Tez reference in the issue to confirm the parameter is supported; done means the statement parses successfully without regressing existing Hive syntax.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust, sql
Domain
compilers
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
38/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.