dotnet / dotnet/machinelearning

Add efficient way of concatenating multiple DataFrame objects

Open
#7,332 1 comment 2 reactions 0 assignees View on GitHub
area-DataFrame enhancement
Dominant language
C#
Stars
9.4k
Forks
2k
Avg merge
2d 20h
Merged PRs (30d)
11

Description

Whilst there is the ability to append a DataFrame to another pre-existing frame using the `Append` method it would be great to have a method/overload that allows for the efficient concatenation of multiple DataFrames. Whilst it is possible to loop to perform this function or chain multiple calls it does not seem like that would be a very efficient way of doing things compared to an "under the hood" implementation that could better optimise for performance.

An example of such functionality can be seen with R's `rbindlist()` function in the `data.table` library that will concatenate many large datasets efficiently. It also allows for matching by column names and filling of missing values, although that would not be needed in an initial implementation.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.