kubeflow / kubeflow/spark-operator

[Spark Connect] Known Bugs

Open
#2,967 1 comment 0 reactions 0 assignees View on GitHub
kind/bug
Dominant language
Python
Stars
3.2k
Forks
1.5k
Avg merge
5d 10h
Merged PRs (30d)
13

Description

### What happened?

Documenting Spark Connect issues here before promoting it.

1. Spark Connect does not show useful things in events such as: Invalid configuration like specifying non-existing service accounts, Status transitions, failure status
2. Ports are not defined.
3. No additional printer columns. We need to expose useful info here.
4. Hardcoded ports: https://github.com/nabuskey/spark-operator/blob/0e625a94d4f8548e317d36d7d62cc44018236c7e/internal/controller/sparkconnect/options.go#L180-L181

Contributor guide

Open the contributing guide

Research direction

Start with internal/controller/sparkconnect/options.go at the referenced hardcoded-port lines, then inspect the Spark Connect event, status, port, and printer-column handling mentioned in the issue. Done means the listed missing information and hardcoded ports have been addressed, but the issue does not define separate acceptance criteria for each item.

Written by the indexing model from the issue text.

Assessment

Tech stack
kubernetes, spark
Domain
devops, infrastructure
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.