stackabletech/spark-k8s-operator

View on GitHub

Kubernetes operator for Apache Spark. Run Spark applications on Kubernetes with the Stackable Data Platform (SDP).

Stars: 72
Forks: 4
Open beginner issues: 0
Indexed issues: 42
Avg merge: 2d 15h
Merged PRs (30d): 15

Dominant language: Rust
License: No license data
Last GitHub push: Sep 15, 2026
Latest indexed: Sep 19, 2026
Contributing guide: No contributing guide
Code of conduct: No code of conduct
Beginner labels: good first issue

Beginner friendly Everything

Open All

42 open issues indexed

Allow defining a time to live for finished SparkApplication driver pods Open

Difficulty 4/5 3-5 days Newbie friendliness 55/100

stackabletech/spark-k8s-operator#774 · 1 comment · Opened Sep 15, 2026
Clean up orphaned driver pods after #758 is installed Open

type/bug

Difficulty 4/5 3-5 days Newbie friendliness 45/100

stackabletech/spark-k8s-operator#770 · Opened Sep 11, 2026
sparkImage.pullPolicy does not propagate to driver Open

type/bug

Difficulty 3/5 1-2 days Newbie friendliness 55/100

stackabletech/spark-k8s-operator#762 · Opened Sep 2, 2026
Disable verbose containerdebug logging in Spark Kubernetes operator Open

type/bug

Difficulty 3/5 1-2 days Newbie friendliness 52/100

stackabletech/spark-k8s-operator#730 · 5 comments · Opened Jul 22, 2026
Spark CR deletion leaves orphaned pods Open

customer-request type/bug

Difficulty 4/5 3-5 days Newbie friendliness 45/100

stackabletech/spark-k8s-operator#701 · 1 comment · Opened Jun 16, 2026
submit spark application java.lang.ClassNotFoundException: org.apache.spark.deploy.k8s.features.VolcanoFeatureStep Open

type/bug

Difficulty 4/5 3-5 days Newbie friendliness 35/100

stackabletech/spark-k8s-operator#669 · 1 comment · Opened Mar 12, 2026
SparkApplication CRD improvements Open

refinement-needed

stackabletech/spark-k8s-operator#659 · 1 assignee · Opened Feb 25, 2026
BUG: spark application can have multiple drivers at once Open

type/bug

Difficulty 4/5 3-5 days Newbie friendliness 35/100

stackabletech/spark-k8s-operator#646 · 3 comments · Opened Jan 29, 2026
After update from stackable operators from 24.7 to 25.11 im getting error Unable to execute HTTP request: Cannot assign requested address Open

type/bug

Difficulty 4/5 3-5 days Newbie friendliness 30/100

stackabletech/spark-k8s-operator#634 · 4 comments · Opened Nov 27, 2025
spark history server has empty security.properties Open

type/bug

Difficulty 3/5 1-2 days Newbie friendliness 42/100

stackabletech/spark-k8s-operator#542 · Opened Mar 26, 2025
Add driver information to the application status Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

stackabletech/spark-k8s-operator#538 · Opened Mar 20, 2025
Iceberg jobs with with Hive 4.0.1 failure Open

type/bug

Difficulty 4/5 3-5 days Newbie friendliness 35/100

stackabletech/spark-k8s-operator#537 · Opened Mar 19, 2025
Deploy Spark application artifacts from Git repositories Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

stackabletech/spark-k8s-operator#536 · 1 comment · Opened Mar 18, 2025
cannot configure a secret class only for tls validation Open

type/bug

Difficulty 4/5 3-5 days Newbie friendliness 25/100

stackabletech/spark-k8s-operator#529 · 2 comments · Opened Feb 27, 2025
RUSTSEC-2025-0007: *ring* is unmaintained Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

stackabletech/spark-k8s-operator#527 · Opened Feb 22, 2025
Use operator-rs `build_rbac_resources` instead of own implementation Open

type/internal-debt

Difficulty 4/5 3-5 days Newbie friendliness 35/100

stackabletech/spark-k8s-operator#499 · Opened Nov 25, 2024
SparkApplication shouldn't delete until the pods have been deleted Open

type/bug

Difficulty 4/5 3-5 days Newbie friendliness 35/100

stackabletech/spark-k8s-operator#493 · Opened Nov 14, 2024
RUSTSEC-2024-0384: `instant` is unmaintained Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

stackabletech/spark-k8s-operator#489 · Opened Nov 11, 2024
RUSTSEC-2024-0388: `derivative` is unmaintained; consider using an alternative Open

Difficulty 4/5 3-5 days Newbie friendliness 30/100

stackabletech/spark-k8s-operator#488 · Opened Nov 11, 2024
dynamically create ingress for running sparkapplication to access spark-ui outside of the k8s cluster Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

stackabletech/spark-k8s-operator#454 · 2 comments · Opened Aug 16, 2024
Spark options set by the user are not handled properly Open

type/bug

Difficulty 3/5 1-2 days Newbie friendliness 35/100

stackabletech/spark-k8s-operator#431 · 4 comments · Opened Jul 19, 2024
Make the History Server storage configuration shareable/reusable/discoverable Open

customer-request

Difficulty 5/5 Over a week Newbie friendliness 25/100

stackabletech/spark-k8s-operator#415 · 1 comment · 1 reaction · Opened Jun 20, 2024
Dependency Dashboard Open

Difficulty 4/5 3-5 days Newbie friendliness 15/100

stackabletech/spark-k8s-operator#407 · Opened May 14, 2024
Investigate dynamic JDBC driver provisioning Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

stackabletech/spark-k8s-operator#391 · 9 comments · Opened Apr 19, 2024
Add additional Spark Properties via Configmap Open

customer-request type/feature-improvement

Difficulty 3/5 1-2 days Newbie friendliness 35/100

stackabletech/spark-k8s-operator#388 · Opened Apr 12, 2024
Support syncing PySpark applications from Git Open

customer-request type/feature-new

Difficulty 5/5 Over a week Newbie friendliness 25/100

stackabletech/spark-k8s-operator#372 · 1 comment · Opened Mar 8, 2024
Kerberos support for Spark job Open

customer-request

Difficulty 4/5 3-5 days Newbie friendliness 32/100

stackabletech/spark-k8s-operator#317 · Opened Dec 7, 2023
Spark History Server support for HDFS Open

customer-request

stackabletech/spark-k8s-operator#298 · 1 assignee · Opened Oct 18, 2023
Monitoring Dashboard Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

stackabletech/spark-k8s-operator#295 · Opened Oct 15, 2023
Document how to build and use custom images Open

area/documentation good first issue

Difficulty 2/5 1-2 days Newbie friendliness 45/100

stackabletech/spark-k8s-operator#246 · 1 comment · Opened Jun 1, 2023
Feature request: Passing Tolerations to executor pods Open

customer-request

Difficulty 4/5 3-5 days Newbie friendliness 38/100

stackabletech/spark-k8s-operator#240 · 3 comments · Opened May 5, 2023
Operator fails "silently" to update Spark Cluster's resource Open

customer-request type/bug

Difficulty 4/5 3-5 days Newbie friendliness 35/100

stackabletech/spark-k8s-operator#239 · Opened May 5, 2023
Document python requirements install will not work in offline cluster Open

area/documentation

Difficulty 1/5 Under an hour Newbie friendliness 50/100

stackabletech/spark-k8s-operator#227 · Opened Apr 3, 2023
Add support for deploying stand alone Spark clusters Open

type/feature-new

Difficulty 5/5 Over a week Newbie friendliness 25/100

stackabletech/spark-k8s-operator#203 · 1 comment · Opened Feb 7, 2023
better/more debugging options Open

type/feature-new

Difficulty 3/5 1-2 days Newbie friendliness 35/100

stackabletech/spark-k8s-operator#163 · 2 comments · Opened Oct 17, 2022
Add support for Volcano Open

customer-request type/feature-improvement

Difficulty 5/5 Over a week Newbie friendliness 35/100

stackabletech/spark-k8s-operator#158 · 2 comments · 1 reaction · Opened Oct 11, 2022
Implement job restart policies Open

type/feature-improvement

Difficulty 5/5 Over a week Newbie friendliness 25/100

stackabletech/spark-k8s-operator#157 · 3 comments · Opened Oct 11, 2022
Implement some form of deletion policy for Spark applications Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

stackabletech/spark-k8s-operator#155 · Opened Oct 7, 2022
External resources: replace PVC-usage with dependency sources Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

stackabletech/spark-k8s-operator#117 · Opened Aug 16, 2022
Investigate hardware accelerated Spark Open

epic

Difficulty 5/5 Over a week Newbie friendliness 18/100

stackabletech/spark-k8s-operator#56 · Opened Apr 28, 2022
Implement integration with hdfs Open

customer-request type/feature-new

Difficulty 4/5 3-5 days Newbie friendliness 35/100

stackabletech/spark-k8s-operator#26 · 1 comment · Opened Mar 23, 2022
Improve operator stability Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

stackabletech/spark-k8s-operator#23 · 1 comment · Opened Mar 23, 2022

stackabletech/spark-k8s-operator

Get new issues in your inbox