Azure / Azure/MachineLearningNotebooks

Is it possible to retrieve metadata associated with the blobs using Datastore?

Open
#1,286 4 comments 0 reactions 1 assignee Claimed by @MayMSFT View on GitHub
ADO Data4ML product-gap product-question
Dominant language
Jupyter Notebook
Stars
4.4k
Forks
2.6k
PR merge metrics
No merged PRs in 30d

Description

We have some images in Azure storage account. All those images (blobs) have metadata .
calling download we can download the files from the provided path but we are missing the metadata associated to those files.
In fact metadata of the files contains important information on each image (e.g. tags) that we need them in our ML pipeline.
Is there any way to keep metadata of a blob storage when we download?
E.g.:
```python
blob_datastore = Datastore.register_azure_blob_container(workspace=aml_workspace,
datastore_name=blob_datastore_name,
container_name=container_name,
account_name=account_name,
account_key=account_key)

def_blob_store = Datastore(aml_workspace, "train")

datastore_path = [
DataPath(def_blob_store, '*.jpeg')]

file_dataset = Dataset.File.from_files(path=datastore_path)
file_dataset.download("files")
```
---
#### Document Details

⚠ *Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.*

* ID: b080f459-b191-a60e-e327-720ef095165c
* Version Independent ID: 53d1b412-0c47-1044-3c6c-7c8c0f1eb0c0
* Content: [azureml.data.FileDataset class - Azure Machine Learning Python](https://docs.microsoft.com/en-us/python/api/azureml-core/azureml.data.filedataset?view=azure-ml-py)
* Content Source: [AzureML-Docset/stable/docs-ref-autogen/azureml-core/azureml.data.FileDataset.yml](https://github.com/MicrosoftDocs/MachineLearning-Python-pr/blob/live/AzureML-Docset/stable/docs-ref-autogen/azureml-core/azureml.data.FileDataset.yml)
* Service: **machine-learning**
* Sub-service: **core**
* GitHub Login: @DebFro
* Microsoft Alias: **debfro**

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.