kubeflow / kubeflow/spark-operator
[Spark Connect] Known Bugs
- Dominant language
- Python
- Stars
- 3.2k
- Forks
- 1.5k
- Avg merge
- 5d 10h
- Merged PRs (30d)
- 13
Description
### What happened?
Documenting Spark Connect issues here before promoting it.
1. Spark Connect does not show useful things in events such as: Invalid configuration like specifying non-existing service accounts, Status transitions, failure status
2. Ports are not defined.
3. No additional printer columns. We need to expose useful info here.
4. Hardcoded ports: https://github.com/nabuskey/spark-operator/blob/0e625a94d4f8548e317d36d7d62cc44018236c7e/internal/controller/sparkconnect/options.go#L180-L181
Contributor guide
Research direction
Start with internal/controller/sparkconnect/options.go at the referenced hardcoded-port lines, then inspect the Spark Connect event, status, port, and printer-column handling mentioned in the issue. Done means the listed missing information and hardcoded ports have been addressed, but the issue does not define separate acceptance criteria for each item.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- kubernetes, spark
- Domain
- devops, infrastructure
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100