dotnet / dotnet/machinelearning

Move DataFrame into separate repo without any dependency on ML .Net libraries

Open
#6,887 3 comments 4 reactions 1 assignee Claimed by @JakeRadMSFT View on GitHub
area-DataFrame enhancement untriaged
Dominant language
C#
Stars
9.4k
Forks
2k
Avg merge
2d 20h
Merged PRs (30d)
11

Description

**Is your feature request related to a problem? Please describe.**

Currently DataFrame release cycle depends on ML .NET (major version of the DataFrame is released with ML .NET once a year)
DataFrame nuget package also has depency on Microsoft.ML.DataView (which is not required for some of the users, that use DataFrame for data analysis without using ML .Net features).

Having separate DataFrame repo without dependency on ML. NET will allow to increase the speed of development new DataFrame
features and decrease time to market.
Having ML .NET dependency on particular version of DataFrame nuget package instead of the latest on the other hand increases stability of ML .NET. It aslo allows ML .NET to support wider range of .Net framework, while the newest version of the DataFrame may drop support of legacy .Net standard and go on with the latest LTS only.

**Describe the solution you'd like**
ML .Net should provide extension methods for converting the DataFrame into IDataView and backward, also it should provide ML specific columns (currently VBufferDataFrameColumn) .

The DataFrame shouldn't have any specific ML .NET columns and functionality (only Apache Arrow compatible types) and no dependencies on ML .NET packages.

The DataFrame should be moved to a separate repo.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.