dotnet / dotnet/machinelearning-modelbuilder

Suggestion: Allow downloading CSV from a web location

Open
#1,587 3 comments 0 reactions 1 assignee Claimed by @LittleLittleCloud View on GitHub
Code Example? Feature request Priority:2 Reported by: Customer Stale
Dominant language
Dockerfile
Stars
285
Forks
66
PR merge metrics
No merged PRs in 30d

Description

**Is your feature request related to a problem? Please describe.**
A multi-location or remote team using Git may have datasets stored in different locations which prevents using .mbconfig file for retraining without editing the JSON. Dataset may also be updated and need to be sent for all team members. Ideally, there would be a way to request the latest dataset when starting training.

**Describe the solution you'd like**
One way would be to allow putting a URL in the file path (file source?) of the JSON file.
![image](https://user-images.githubusercontent.com/26261427/125193579-c202e800-e255-11eb-80ef-984b150b2de6.png)

Model Builder would then download the dataset from that location upon start. It would allow data preparation team to simply update one location with the latest file, and all locations would always use the latest versions. As a copy of the original dataset is anyway made from the origin, so I suppose it could as well be downloaded from an online location.

A bonus would be a simplification of ML.NET tutorials because users could just download the .mbconfig file and just run it.

**Additional context**
This might also allow creation of "training agents" by MS or the community. Agent could just get .mbconfig file and train it.

It should be considered what to do with the file after the training has finished. It might be a good idea to delete it, or ask user if it should be deleted, to not consume disk space with something the user did not explicitly download.

If .mbconfig files would be shared freely, it may be a security concern as the .mbconfig could request to download malicious files. Anyway, I think the benefits outweight the risks at least for data science teams, but the risks may be greater for teams or developer with less need for dataset sharing. Potentially, showing a dialogue "This file requests to download .....Make sure it is trusted location ... OK?" could be enough.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.