dotnet / dotnet/spark

[FEATURE REQUEST]: Spark 4.0 support for VariantType

Open
#1,218 0 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
C#
Stars
2.1k
Forks
332
Avg merge
1d 20h
Merged PRs (30d)
9

Description

**Is your feature request related to a problem? Please describe.**
Need to utilize the VariantType data type in Spark 4.0 to describe things like JsonObject in a schema.

**Describe the solution you'd like**
Add `VariantType` as a supported data type.

**Describe alternatives you've considered**
Making my own data type for the time being...

```csharp
public sealed class VariantType : DataType
{
}
```

**Additional context**
https://spark.apache.org/docs/latest/api/java//org/apache/spark/sql/types/DataTypes.html

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.