[Improvement] If the kyuubi server is unavailable, stop the spark application immediately and release cluster's resources
- Dominant language
- Scala
- Stars
- 2.4k
- Forks
- 1k
- PR merge metrics
- No merged PRs in 30d
Description
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
### Search before asking
- [X] I have searched in the [issues](https://github.com/apache/incubator-kyuubi/issues?q=is%3Aissue) and found no similar issues.
### What would you like to be improved?
The Spark application will exist for a while when the kyuubi server is uninstalled or both servers are stopped, which waste the cluster's resources
### How should we improve?
If the kyuubi server is unavailable, stop the spark application immediately and release cluster's resources
### Are you willing to submit PR?
- [X] Yes I am willing to submit a PR!
Contributor guide
Research direction
Start by tracing how the Spark application detects and communicates with the Kyuubi server, then inspect the server and application lifecycle paths. Reproduce the unavailable-server case described in the issue and verify that the Spark application stops promptly and releases cluster resources.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- scala, spark
- Domain
- backend, distributed-systems
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100