Azure / Azure/MachineLearningNotebooks

AML: When using ParallelRun with a Tabular Dataset, is the delimiter always a `space` - clarify documenation/example

Ouverte
#1,486 1 commentaire 0 réactions 0 personnes assignées Voir sur GitHub
ADO Data4ML MLOps Pipelines
Langage dominant
Jupyter Notebook
Étoiles
4.4k
Forks
2.6k
Métriques de merge des PR
Aucune PR mergée en 30 j

Description

@keijik @cody-dkdc @gregce

In [this example notebook](https://github.com/Azure/MachineLearningNotebooks/blob/master/how-to-use-azureml/machine-learning-pipelines/parallel-run/tabular-dataset-inference-iris.ipynb) you show the delimter in the file that is written to as being a space. Using space a delimiter seems like a really dangerous choice. Can you change what the delimiter is? If so how? It seems like from this example that this is the default delimiter for tabular datasets which seem problematic.

![image](https://user-images.githubusercontent.com/1483922/119240979-54192a80-bb08-11eb-9b48-246650a3f5ed.png)

The scoring script for this [example is here](https://github.com/Azure/MachineLearningNotebooks/blob/master/how-to-use-azureml/machine-learning-pipelines/parallel-run/Code/iris_score.py) as you can see, space is not indicated anywhere in the scoring script, so how does this delimiter come out? If this is the default delimiter, I think this is worth explaining.

[iris_score.py](https://github.com/Azure/MachineLearningNotebooks/blob/master/how-to-use-azureml/machine-learning-pipelines/parallel-run/Code/iris_score.py)

```py
import io
import pickle
import argparse
import numpy as np

from azureml.core.model import Model
from sklearn.linear_model import LogisticRegression

from azureml_user.parallel_run import EntryScript

def init():
global iris_model

logger = EntryScript().logger
logger.info("init() is called.")

parser = argparse.ArgumentParser(description="Iris model serving")
parser.add_argument('--model_name', dest="model_name", required=True)
args, unknown_args = parser.parse_known_args()

model_path = Model.get_model_path(args.model_name)
with open(model_path, 'rb') as model_file:
iris_model = pickle.load(model_file)

def run(input_data):
logger = EntryScript().logger
logger.info("run() is called with: {}.".format(input_data))

# make inference
num_rows, num_cols = input_data.shape
pred = iris_model.predict(input_data).reshape((num_rows, 1))

# cleanup output
result = input_data.drop(input_data.columns[4:], axis=1)
result['variety'] = pred

return result
```

Guide de contribution

Aucun guide de contribution indexé pour ce dépôt

Évaluation

Cette issue n'a pas encore été évaluée.

Recevez les nouvelles issues par e-mail

Un résumé court des issues GitHub adaptées aux débutants.