Azure / Azure/MachineLearningNotebooks

Get access to the source information of a FileDataset

Open
#1,005 11 comments 0 reactions 1 assignee Claimed by @MayMSFT View on GitHub
ADO Data4ML product-gap product-question
Dominant language
Jupyter Notebook
Stars
4.4k
Forks
2.6k
PR merge metrics
No merged PRs in 30d

Description

Hello all,

I would like to get access to the source information of a FileDataset.
If you consider the following code:

```python
ds = ws.datasets['myfiledataset']
print(str(ds))
```

Then there is an output like the following:
```
FileDataset
{
"source": [
"('datastorename', 'container/folder/')"
],
"definition": [
"GetDatastoreFiles"
],
"registration": {
"id": "66882",
"name": "dataset_name",
"version": 1,
"workspace": "Workspace.create(name='', subscription_id='', resource_group='')"
}
}
```

Is there a documented & supported way to get access to that source information (the data store name and the folder on that location)? I want to reference the FileDataset and build a `DataReferenceConfiguration` object out of it (where I need the `datastore_name` and the `path_on_datastore`)

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.