[TASK][MEDIUM] Hive engine supports Apache Hive 4.0.0

### What's the level of this task?

MEDIUM

### Code of Conduct

- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)

### Search before creating

- [X] I have searched in the [task list](https://github.com/orgs/apache/projects/343) and found no similar tasks.

### Mentor

- [ ] I have sufficient expertise on this task, and I volunteer to be a mentor of this task to guide contributors through the task.

### Skill requirements

- Scala
- Hive/MR/Tez
- YARN
- Hadoop Security / Kerberos (optional)

### Background and Goals

Currently, the Kyuubi Hive engine supports
- Cloudera Hive 2.1.1-cdh6
- Apache Hive 2.3
- Apache Hive 3.1

in both local and YARN deploy mode, and both SIMPLE and KERBEROS security mode.

Apache Hive released 4.0.0 on 29 March 2024 https://hive.apache.org/general/downloads/, we'd like to add support for this latest version too.

### Implementation steps

change code/test/GHA workflows and make CI happy.

### Additional context

Introduction of [2024H1 Kyuubi Code Contribution Program](https://github.com/apache/kyuubi/issues/6232)

This may help for testing https://github.com/awesome-kyuubi/hadoop-testing