dotnet / dotnet/spark

[FEATURE REQUEST]: Call dotnet UDFs directly from Scala or Java code

Open
#800 3 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
C#
Stars
2.1k
Forks
332
Avg merge
1d 20h
Merged PRs (30d)
9

Description

Let me first say, perhaps this is possible today but I haven't seen any documentation on it. If that is the case, perhaps then just documentation is needed.

**Is your feature request related to a problem? Please describe.**
I'd like to be able to call the our dotnet UDFs directly from Scala or Java code. This is because our UDFs wrap a set of function calls we already have implemented in C# and we'd like to not have to reimplement them in other languages as well. Furthermore, we are also using these UDFs today in production on spark-submit jobs.

**Describe the solution you'd like**
Ability to register my UDFs in Scala code and call them just as regular Scala UDFs.

**Describe alternatives you've considered**
Alternatively, I could reimplement all my UDFs in Scala or PySpark but this is less than ideal due to the amount of code.

**Additional context**
Add any other context or screenshots about the feature request here.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.