apache/spark

Apache Spark - A unified analytics engine for large-scale data processing

Stars: 44k
Forks: 29.4k
Open beginner issues: 0
Indexed issues: 32

Dominant language: Scala
License: Apache-2.0
Last GitHub push: Sep 14, 2026
Latest indexed: Sep 14, 2026
Contributing guide: Contributing guide
Code of conduct: Code of conduct
Beginner labels: No beginner labels indexed
PR merge metrics: No merged PRs in 30d

Open All

31 open issues indexed

[FEATURE REQUEST] Add ADBC (Arrow Database Connectivity) Data Source Open

apache/spark#54603 · 9 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Expose `preOptimizerRules` in session extensions API Open

apache/spark#54687 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Is Spark limited to split the Parquet read granularity by Row Group level only? Open

apache/spark#55747 · 5 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Automatically create the spark history log directory Open

apache/spark#55975 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[SPARK-57415][SQL] Parquet vectorized reader performance improvements (umbrella) Open

apache/spark#56011 · 2 comments · 1 reaction · 0 assignees · Indexed Sep 14, 2026
exitStatusCode:0 The return code of spark-submit is 0 Open

apache/spark#56539 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[PYTHON][PYSPARK][FUNCTIONS] pyspark.sql.functions.try_to_date is missing in PySpark 4.0.0-4.0.4 but the docs say it became available in 4.0.0 Open

apache/spark#56672 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
OracleDialect: Hardcoded scale of 10 in Decimal(38,10) causes silent precision loss for bare NUMBER columns Open

apache/spark#56738 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[SparkConnect] Support url path in SparkConnect connection string Open

apache/spark#56816 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[SPARK-57743][SQL] Addition of a partition function in datalake V1 tables Open

apache/spark#56833 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
EXPLAIN COST gives wrong estimated input size when querying via VIEW instead of physical Delta path Open

apache/spark#56990 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[SQL] Exchange reuse fails when a VIEW is referenced in both UNION ALL branches via a CTE Open

apache/spark#57109 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Spark Streaming (DStream) UI / receiver diagnostics not reliably available after EMR cluster termination Open

apache/spark#57113 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Spark Connect server retains high JVM memory and leading to restarts causing jobs to fail Open

apache/spark#57123 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[BUILD] Drop oro dependency Open

apache/spark#57209 · 7 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[K8S][CORE] Heartbeat-timeout executor replacement may be classified as ExecutorKilled and skip task failure counting Open

apache/spark#57494 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[CORE] bug report: collision of resource profile id Open

apache/spark#57498 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[DISCUSS][CORE] Should managed off-heap memory take the container limit into account? Open

apache/spark#57530 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[SQL] Add CASE WHEN equivalent for the DECODE function Open

apache/spark#57534 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[SQL] EXTRACT and DATE_PART function for 'SECOND' parameter returns decimal(8,6), otherwise SECOND function returns integer Open

apache/spark#57535 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[SQL] Clarify bitmap_or_agg / bitmap_and_agg input contract: fixed 4096-byte vs. variable-length bitmaps Open

apache/spark#57561 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[SQL][CONNECT] SparkConnectClient may drop metadata (auth headers) on retried/reattached RPCs if metadata is a non-list iterable Open

apache/spark#57785 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[PIPELINES] Support partition transforms in SDP partition_cols Open

apache/spark#57908 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[DOC] HTML Table broken in sql-error-conditions Open

apache/spark#58094 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Github workflow for scanning CVEs Open

apache/spark#58290 · 2 comments · 2 reactions · 0 assignees · Indexed Sep 14, 2026
[K8S] Extend avoidDownloadSchemes to spark.files so executors can read uploaded files directly Open

apache/spark#58310 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[SQL] State-store instance metrics are shipped in every task result Open

apache/spark#58394 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[SQL] Support fallback resolver for unknown V2 catalog names Open

apache/spark#58444 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Adding delays between JDBC connection retries Open

apache/spark#58474 · 0 comments · 1 reaction · 0 assignees · Indexed Sep 14, 2026
Credential Rotation Open

apache/spark#58475 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[SQL] Row-based Parquet reader silently accepts incompatible primitive type conversions Open

apache/spark#58495 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026

A short digest of beginner-friendly GitHub issues.