dotnet / dotnet/machinelearning
Constructor for Microsoft.Data.Analysis.DataFrame that takes Microsoft.Spark.Sql.DataFrame as param.
- Dominant language
- C#
- Stars
- 9.4k
- Forks
- 2k
- Avg merge
- 2d 20h
- Merged PRs (30d)
- 11
Description
It just would be nice to be able to switch between spark and the analysis package. I'm trying to do some plotting that I'm not sure how to do with spark.
A constructor like:
`public DataFrame(Microsoft.Spark.Sql.DataFrame dataframe)`
or a static function like:
`public DataFrame FromSparkDataFrame(Microsoft.Spark.Sql.DataFrame dataframe)`
**Describe alternatives you've considered**
I've been looking for ways to convert a spark DataFrame into a RecordBatch in order to be able to use the method FromRecordBatch, but hadn't found any relevant documentation either.
**Additional context**
I don't know if it's relevant, but I'm running my code on Synapse Analytics.
Contributor guide
Assessment
This issue has not been assessed yet.