Azure / Azure/MachineLearningNotebooks

infer.py file from forecasting-pipelines sample folder

Offen
#1,878 0 Kommentare 0 Reaktionen 0 zugewiesene Personen Auf GitHub ansehen
Vorherrschende Sprache
Jupyter Notebook
Sterne
4.4k
Forks
2.6k
PR-Merge-Kennzahlen
Keine gemergten PRs in 30 T.

Beschreibung

Hi
Im using the forecasting-pipelines sample, to build a training and inference pipeline. The training pipeline is running without error (I am using some public sales data) but the inferene pipeline is giving me this error:

/azureml-envs/azureml_d1809f029ef68d0db142d99e1cd4a92c/lib/python3.7/site-packages/sklearn/externals/joblib/__init__.py:15: FutureWarning: sklearn.externals.joblib is deprecated in 0.21 and will be removed in 0.23. Please import this functionality directly from joblib, which can be installed with: pip install joblib. If this warning is raised when loading pickled models, you may need to re-serialize those models with scikit-learn 0.21+.
warnings.warn(msg, category=FutureWarning)
args passed are:
ojmodel
dominicks_OJ_test_pipeline
oj-output
Sales
model.pkl
azureml-models/ojmodel/36/outputs/model.pkl
Importing plotly failed. Interactive plots will not work.
/bin/bash: /azureml-envs/azureml_d1809f029ef68d0db142d99e1cd4a92c/lib/libtinfo.so.6: no version information available (required by /bin/bash)
/bin/bash: /azureml-envs/azureml_d1809f029ef68d0db142d99e1cd4a92c/lib/libtinfo.so.6: no version information available (required by /bin/bash)
/bin/bash: /azureml-envs/azureml_d1809f029ef68d0db142d99e1cd4a92c/lib/libtinfo.so.6: no version information available (required by /bin/bash)
/bin/bash: /azureml-envs/azureml_d1809f029ef68d0db142d99e1cd4a92c/lib/libtinfo.so.6: no version information available (required by /bin/bash)
/bin/bash: /azureml-envs/azureml_d1809f029ef68d0db142d99e1cd4a92c/lib/libtinfo.so.6: no version information available (required by /bin/bash)
/bin/bash: /azureml-envs/azureml_d1809f029ef68d0db142d99e1cd4a92c/lib/libtinfo.so.6: no version information available (required by /bin/bash)
/bin/bash: /azureml-envs/azureml_d1809f029ef68d0db142d99e1cd4a92c/lib/libtinfo.so.6: no version information available (required by /bin/bash)
/bin/bash: /azureml-envs/azureml_d1809f029ef68d0db142d99e1cd4a92c/lib/libtinfo.so.6: no version information available (required by /bin/bash)
/bin/bash: /azureml-envs/azureml_d1809f029ef68d0db142d99e1cd4a92c/lib/libtinfo.so.6: no version information available (required by /bin/bash)
/bin/bash: /azureml-envs/azureml_d1809f029ef68d0db142d99e1cd4a92c/lib/libtinfo.so.6: no version information available (required by /bin/bash)
/bin/bash: /azureml-envs/azureml_d1809f029ef68d0db142d99e1cd4a92c/lib/libtinfo.so.6: no version information available (required by /bin/bash)
/bin/bash: /azureml-envs/azureml_d1809f029ef68d0db142d99e1cd4a92c/lib/libtinfo.so.6: no version information available (required by /bin/bash)
/bin/bash: /azureml-envs/azureml_d1809f029ef68d0db142d99e1cd4a92c/lib/libtinfo.so.6: no version information available (required by /bin/bash)
/bin/bash: /azureml-envs/azureml_d1809f029ef68d0db142d99e1cd4a92c/lib/libtinfo.so.6: no version information available (required by /bin/bash)
Validating arguments.
Arguments validated.
Successfully obtained datastore reference and path.
Uploading file to 2023-01-27-6571d9/7dc81504-f7db-43d2-b7f2-18f10c631e05/
Cleaning up all outstanding Run operations, waiting 300.0 seconds
1 items cleaning up...
Cleanup took 0.09214901924133301 seconds
Traceback (most recent call last):
File "infer.py", line 154, in
X_test_df, y_test, fitted_model, args.output_path, ouput_dataset_name
File "infer.py", line 39, in infer_forecasting_dataset_tcn
name=output_dataset_name,
File "/azureml-envs/azureml_d1809f029ef68d0db142d99e1cd4a92c/lib/python3.7/site-packages/azureml/data/_loggerfactory.py", line 132, in wrapper
return func(*args, **kwargs)
File "/azureml-envs/azureml_d1809f029ef68d0db142d99e1cd4a92c/lib/python3.7/site-packages/azureml/data/dataset_factory.py", line 655, in register_pandas_dataframe
dflow.write_to_parquet(directory_path=target_directory_path).run_local()
File "/azureml-envs/azureml_d1809f029ef68d0db142d99e1cd4a92c/lib/python3.7/site-packages/azureml/dataprep/api/_loggerfactory.py", line 273, in wrapper
return func(*args, **kwargs)
File "/azureml-envs/azureml_d1809f029ef68d0db142d99e1cd4a92c/lib/python3.7/site-packages/azureml/dataprep/api/dataflow.py", line 636, in run_local
_execute('Dataflow.run_local', self, span_context=to_dprep_span_context(span.get_context()))
File "/azureml-envs/azureml_d1809f029ef68d0db142d99e1cd4a92c/lib/python3.7/site-packages/azureml/dataprep/api/_dataframereader.py", line 608, in _execute
return clex_execute()
File "/azureml-envs/azureml_d1809f029ef68d0db142d99e1cd4a92c/lib/python3.7/site-packages/azureml/dataprep/api/_dataframereader.py", line 440, in clex_execute
anonymous_activity=activity_data, span_context=span_context
File "/azureml-envs/azureml_d1809f029ef68d0db142d99e1cd4a92c/lib/python3.7/site-packages/azureml/dataprep/api/_aml_helper.py", line 44, in wrapper
return send_message_func(op_code, message, cancellation_token)
File "/azureml-envs/azureml_d1809f029ef68d0db142d99e1cd4a92c/lib/python3.7/site-packages/azureml/dataprep/api/engineapi/api.py", line 159, in execute_anonymous_activity
response = self._message_channel.send_message('Engine.ExecuteActivity', message_args, cancellation_token)
File "/azureml-envs/azureml_d1809f029ef68d0db142d99e1cd4a92c/lib/python3.7/site-packages/azureml/dataprep/api/engineapi/engine.py", line 291, in send_message
raise_engine_error(response['error'])
File "/azureml-envs/azureml_d1809f029ef68d0db142d99e1cd4a92c/lib/python3.7/site-packages/azureml/dataprep/api/errorhandlers.py", line 10, in raise_engine_error
raise ExecutionError(error_response)
azureml.dataprep.api.errorhandlers.ExecutionError:
Error Code: ScriptExecution.ReadDataFrame.StreamAccess.Validation
Validation Error Code: Invalid
Validation Target: PreppyFile
Failed Step: 9cf6aeee-adcf-4f1e-acbd-b5529e4402ad
Error Message: ScriptExecutionException was caused by ReadDataFrameException.
Failed to read Pandas DataFrame form Python host. Make sure Dataflow is created directly from the source Pandas DataFrame.
StreamAccessException was caused by ValidationException.
Trying to read an invalid file. Missing sentinel value in the beginning
| session_id=b6a0e361-a061-4fb9-ba08-9567b9f3994b

I am using the infor.py copied directly from the sample "forecasting-pipelines" file - does it have to be change in some way? or is it something else that is causing the error?

´´´
inference_pipeline = Pipeline(ws, [inference_step])
inference_run = experiment.submit(inference_pipeline)
´´´

Beitragsleitfaden

Für dieses Repository ist kein Beitragsleitfaden indexiert

Rechercherichtung

Beginne damit, infer.py aus dem Beispiel forecasting-pipelines mit den Traceback-Positionen in den Zeilen 39 und 154 zu vergleichen, und reproduziere anschließend die Inference-Pipeline mit den gemeldeten Verkaufsdaten und Argumenten. Untersuche den Fehler bei der Registrierung des Azure ML-Datasets und bestätige, dass die Pipeline ohne den Fehler invalid-file erfolgreich abgeschlossen wird.

Vom Indexierungsmodell aus dem Issue-Text verfasst.

Bewertung

Tech-Stack
azure, python
Bereich
cloud, machine-learning
Issue-Typ
Bug
Schwierigkeit
4/5
Geschätzter Aufwand
3-5 Tage
Aktivitätsstatus
Veraltet
Klarheit
Muss geklärt werden
Anfängerfreundlichkeit
25/100

Neue Issues direkt in Ihr Postfach

Eine kurze Übersicht über anfängerfreundliche GitHub-Issues.