dotnet / dotnet/machinelearning

Constructor for Microsoft.Data.Analysis.DataFrame that takes Microsoft.Spark.Sql.DataFrame as param.

Open
#6,717 4 comments 0 reactions 0 assignees View on GitHub
area-DataFrame enhancement needs-further-triage
Dominant language
C#
Stars
9.4k
Forks
2k
Avg merge
2d 20h
Merged PRs (30d)
11

Description

It just would be nice to be able to switch between spark and the analysis package. I'm trying to do some plotting that I'm not sure how to do with spark.

A constructor like:
`public DataFrame(Microsoft.Spark.Sql.DataFrame dataframe)`

or a static function like:
`public DataFrame FromSparkDataFrame(Microsoft.Spark.Sql.DataFrame dataframe)`

**Describe alternatives you've considered**
I've been looking for ways to convert a spark DataFrame into a RecordBatch in order to be able to use the method FromRecordBatch, but hadn't found any relevant documentation either.

**Additional context**
I don't know if it's relevant, but I'm running my code on Synapse Analytics.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.