dotnet/spark

View on GitHub

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

Stars: 2.1k
Forks: 332
Open beginner issues: 0
Indexed issues: 167
Avg merge: 1d 20h
Merged PRs (30d): 9

Dominant language: C#
License: MIT
Last GitHub push: Sep 11, 2026
Latest indexed: Sep 15, 2026
Contributing guide: Contributing guide
Code of conduct: Code of conduct
Beginner labels: good first issue help wanted

Open All

167 open issues indexed

TPC-DS Functional + SQL Queries Open

enhancement

dotnet/spark#34 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Registering & Invoking other language UDFs (e.g., Java/Scala, Python, R) through .NET API Open

enhancement

dotnet/spark#33 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Implement accumulator in TaskRunner.cs Open

good first issue

dotnet/spark#32 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Use DisplayClass to differentiate delegate with closure. Open

good first issue

dotnet/spark#28 · 2 comments · 0 reactions · 2 assignees · Indexed Sep 15, 2026
Handle "kill" signal better in DaemonServer. Open

enhancement

dotnet/spark#29 · 4 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Write unit tests for SimpleWorker. Open

good first issue

dotnet/spark#31 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Row unpickles long value incorrectly. Open

good first issue

dotnet/spark#27 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Dispose JvmBridge correctly Open

good first issue help wanted

dotnet/spark#24 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Automate scalafmt (formatting rule for Scala) Open

good first issue

dotnet/spark#23 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Automate C# formatting using dotnet-format Open

good first issue

dotnet/spark#19 · 11 comments · 0 reactions · 1 assignee · Indexed Sep 15, 2026
[C#] For public APIs, check nulls for parameters. Open

dotnet/spark#22 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Extract common classes from src/scala/microsoft-spark-<version>. Open

good first issue help wanted

dotnet/spark#15 · 5 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
[Documentation]: Upgrading for a newly release Apache Spark version Open

documentation good first issue help wanted

dotnet/spark#14 · 0 comments · 0 reactions · 1 assignee · Indexed Sep 15, 2026
We should re-enable running tests against netfx Open

enhancement

dotnet/spark#17 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Discussion: Idiomatic F# APIs Open

enhancement

dotnet/spark#41 · 3 comments · 11 reactions · 0 assignees · Indexed Sep 15, 2026
Arrow enabled implementation and comparison with pySpark Open

dotnet/spark#45 · 6 comments · 6 reactions · 0 assignees · Indexed Sep 15, 2026
Publish PDBs to symbol server Open

infrastructure

dotnet/spark#75 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Add config option for installing .NET Core runtime in shared mode Open

enhancement

dotnet/spark#105 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
[Feature Request] : Application file residing in hdfs Open

dotnet/spark#122 · 7 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
[FEATURE REQUEST]: Ubuntu Docker Image with .NET Spark Open

enhancement

dotnet/spark#129 · 0 comments · 3 reactions · 0 assignees · Indexed Sep 15, 2026
[Documentation] Best practice for writing UDFs Open

documentation

dotnet/spark#147 · 2 comments · 0 reactions · 1 assignee · Indexed Sep 15, 2026
Spark Streaming Open

enhancement question

dotnet/spark#155 · 7 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Accessing config/secret values Open

question

dotnet/spark#168 · 13 comments · 10 reactions · 0 assignees · Indexed Sep 15, 2026
[FEATURE REQUEST]: Add Application .Zip file contents to Assembly Search Path Open

enhancement

dotnet/spark#192 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Where to find possible streaming formats? Open

question

dotnet/spark#197 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
[FEATURE REQUEST]: Support variable length inputs to UDF Open

enhancement

dotnet/spark#200 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Unable to load elasticsearch class Open

question

dotnet/spark#213 · 6 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
[FEATURE REQUEST]: Add support/docs for K8s spark operator Open

enhancement

dotnet/spark#219 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
"Stream is closed" error, but program finishes executing correctly Open

dotnet/spark#249 · 6 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Can you refer any documentation that explains how to use MapKeys, MAP and MapValues functions? Open

question

dotnet/spark#280 · 5 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
[FEATURE REQUEST]: Consider adding support for common RDD operations Open

enhancement

dotnet/spark#284 · 9 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
[FEATURE REQUEST]: Consider adding support for ValueTuples when defining UDFs Open

enhancement

dotnet/spark#285 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
[FEATURE REQUEST]: Add support for MapTypes in Vector UDFs Open

enhancement

dotnet/spark#286 · 4 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
[FEATURE REQUEST]: Add support or documentation/examples on how to connect to common Azure services Open

enhancement

dotnet/spark#287 · 5 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
[FEATURE REQUEST]: Consider making the execution of UDF lambda functions more performant Open

enhancement

dotnet/spark#288 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
.NET for Apache Spark JDBC to connect to Postgresql Open

question

dotnet/spark#303 · 7 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
[FEATURE REQUEST]: support for something like dbutils to move/copy/delete data easily Open

enhancement

dotnet/spark#328 · 5 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
[FEATURE REQUEST]: Introduce StyleCop to the repo. Open

enhancement

dotnet/spark#343 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
[FEATURE REQUEST]: Request for support of reducebykey on dataframes Open

enhancement

dotnet/spark#346 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
[FEATURE REQUEST]: Use System.Text.Json for Json serialisation Open

enhancement

dotnet/spark#355 · 2 comments · 0 reactions · 1 assignee · Indexed Sep 15, 2026
[FEATURE REQUEST]: Ability to write to an SQLServer database within the context of Structured Streaming Open

enhancement

dotnet/spark#367 · 5 comments · 2 reactions · 0 assignees · Indexed Sep 15, 2026
[FEATURE REQUEST]: document blob read push down? Open

enhancement

dotnet/spark#368 · 4 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
[FEATURE REQUEST]: Implement ML Features Open

enhancement good first issue help wanted

dotnet/spark#381 · 22 comments · 4 reactions · 0 assignees · Indexed Sep 15, 2026
[BUG]: Error while running a .net application containing a UDF against remote databricks apache spark (e.g. Azure Databricks) Open

bug

dotnet/spark#384 · 28 comments · 1 reaction · 1 assignee · Indexed Sep 15, 2026
[FEATURE REQUEST]: How to query from Hadoop and deploy in production? Open

question

dotnet/spark#418 · 9 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
[FEATURE REQUEST]: Dotnet Backend IPAddress Open

enhancement

dotnet/spark#419 · 19 comments · 0 reactions · 1 assignee · Indexed Sep 15, 2026
[BUG]: Spark has to be restarted if using UDFs and recompiling Open

question

dotnet/spark#426 · 13 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
[QUESTION]: Streaming example takes a long time to run Open

question

dotnet/spark#447 · 21 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
[FEATURE REQUEST]: Subscribe to get automatic updates from dotnet/arcade Open

enhancement

dotnet/spark#458 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
[BUG]: UDF Group Apply on Azure DataBricks causes NRE at ArrowColumnVector.getChild Open

bug

dotnet/spark#468 · 9 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026

dotnet/spark

Get new issues in your inbox