dotnet / dotnet/machinelearning

DataFrame.LoadCsv method should allow selection of columns

Open
#6,358 0 comments 0 reactions 0 assignees View on GitHub
area-DataFrame enhancement
Dominant language
C#
Stars
9.4k
Forks
2k
Avg merge
2d 20h
Merged PRs (30d)
11

Description

**Is your feature request related to a problem? Please describe.**
**DataFrame.LoadCsv** method currently doesn't allow the selection of columns while processing a CSV file, and loads all the columns and rows into the df object. This may cause inefficiencies in processing in large datasets, if the user needs to work with subsection of the data.

**Describe the solution you'd like**
The method should have a parameter for "Selecting" columns while loading a CSV file into the df object. This improvement is inline with how python Pandas library is structured and helps tremendously. A new parameter named **useColumns** would help to load only selected columns into the df object, thus reducing the unnecessary footprint.

**Describe alternatives you've considered**
Tried columnNames but didn't work as it renames all the columns in order, not working as expected to 'select' only the columns one may need.

**Additional context**
None.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.