Azure / Azure/MachineLearningNotebooks
Is it possible to retrieve metadata associated with the blobs using Datastore?
- Dominant language
- Jupyter Notebook
- Stars
- 4.4k
- Forks
- 2.6k
- PR merge metrics
- No merged PRs in 30d
Description
We have some images in Azure storage account. All those images (blobs) have metadata .
calling download we can download the files from the provided path but we are missing the metadata associated to those files.
In fact metadata of the files contains important information on each image (e.g. tags) that we need them in our ML pipeline.
Is there any way to keep metadata of a blob storage when we download?
E.g.:
```python
blob_datastore = Datastore.register_azure_blob_container(workspace=aml_workspace,
datastore_name=blob_datastore_name,
container_name=container_name,
account_name=account_name,
account_key=account_key)
def_blob_store = Datastore(aml_workspace, "train")
datastore_path = [
DataPath(def_blob_store, '*.jpeg')]
file_dataset = Dataset.File.from_files(path=datastore_path)
file_dataset.download("files")
```
---
#### Document Details
⚠ *Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.*
* ID: b080f459-b191-a60e-e327-720ef095165c
* Version Independent ID: 53d1b412-0c47-1044-3c6c-7c8c0f1eb0c0
* Content: [azureml.data.FileDataset class - Azure Machine Learning Python](https://docs.microsoft.com/en-us/python/api/azureml-core/azureml.data.filedataset?view=azure-ml-py)
* Content Source: [AzureML-Docset/stable/docs-ref-autogen/azureml-core/azureml.data.FileDataset.yml](https://github.com/MicrosoftDocs/MachineLearning-Python-pr/blob/live/AzureML-Docset/stable/docs-ref-autogen/azureml-core/azureml.data.FileDataset.yml)
* Service: **machine-learning**
* Sub-service: **core**
* GitHub Login: @DebFro
* Microsoft Alias: **debfro**
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.