Azure / Azure/azureml-examples
pipeline_with_hyperparameter_sweep: Object 'EXCLUDE' is not a valid value for the 'unknown' parameter
- Dominant language
- Jupyter Notebook
- Stars
- 2k
- Forks
- 1.7k
- Avg merge
- 18h 18m
- Merged PRs (30d)
- 2
Description
## Which example? Describe the issue
example: pipeline_with_hyperparameter_sweep
description: pipeline throws an exception
Exception: Object 'EXCLUDE' is not a valid value for the 'unknown' parameter:
File "C:\Users\isga01\.azure\cliextensions\ml\marshmallow\utils.py", line 343, in validate_unknown_parameter_value
f"Object {obj!r} is not a valid value for the 'unknown' parameter"
ValueError: Object 'EXCLUDE' is not a valid value for the 'unknown' parameter
## Additional context
$> azureml-examples\cli\jobs\pipelines-with-components\pipeline_with_hyperparameter_sweep> az ml job create --file .\pipeline.yml
Uploading train-src (0.0 MBs): 100%|##########################################################################| 3539/3539 [00:00<00:00, 75112.80it/s]
Uploading predict-src (0.0 MBs): 100%|###########################################################################| 711/711 [00:00<00:00, 9051.58it/s]
Exception: Object 'EXCLUDE' is not a valid value for the 'unknown' parameter.
Traceback (most recent call last):
File "C:\Users\isga01\.azure\cliextensions\ml\azext_mlv2\manual\vendored_curated_sdk\azure\ai\ml\entities\_job\job.py", line 286, in _from_rest_object
return PipelineJob._load_from_rest(job_rest_object)
File "C:\Users\isga01\.azure\cliextensions\ml\azext_mlv2\manual\vendored_curated_sdk\azure\ai\ml\entities\_job\pipeline\pipeline_job.py", line 361, in _load_from_rest
sub_nodes[node_name] = Sweep._from_rest_object(node)
File "C:\Users\isga01\.azure\cliextensions\ml\azext_mlv2\manual\vendored_curated_sdk\azure\ai\ml\entities\_builders\sweep.py", line 200, in _from_rest_object
base_sweep = schema.load(obj, unknown="EXCLUDE")
File "C:\Users\isga01\.azure\cliextensions\ml\marshmallow\schema.py", line 723, in load
data, many=many, partial=partial, unknown=unknown, postprocess=True
File "C:\Users\isga01\.azure\cliextensions\ml\marshmallow\schema.py", line 844, in _do_load
else validate_unknown_parameter_value(unknown)
File "C:\Users\isga01\.azure\cliextensions\ml\marshmallow\utils.py", line 343, in validate_unknown_parameter_value
f"Object {obj!r} is not a valid value for the 'unknown' parameter"
ValueError: Object 'EXCLUDE' is not a valid value for the 'unknown' parameter
Unable to parse the job resource: {
"system_data": {
},
"properties": {
"description": "Tune hyperparameters using TF component",
"properties": {
"mlflow.source.git.repoURL": "git@github.com:Azure/azureml-examples.git",
"mlflow.source.git.branch": "main",
"mlflow.source.git.commit": "a6e6df66efb34f93b250463b086f9c9c72a99a16",
"azureml.git.dirty": "True",
"azureml.runsource": "azureml.PipelineRun",
"runSource": "MFE",
"runType": "HTTP",
"azureml.parameters": "{}",
"azureml.continue_on_step_failure": "False",
"azureml.continue_on_failed_optional_input": "True",
"azureml.pipelineComponent": "pipelinerun"
},
"tags": {},
"display_name": "pipeline_with_hyperparameter_sweep",
"experiment_name": "pipeline_with_hyperparameter_sweep",
"is_archived": false,
"job_type": "Pipeline",
"services": {
"Tracking": {
"job_service_type": "Tracking"
},
"Studio": {
"job_service_type": "Studio"
}
},
"status": "Preparing",
"inputs": {},
"jobs": {
"sweep_step": {
"limits": {
"max_concurrent_trials": 3,
"max_total_trials": 5,
"timeout": 7200
},
"sampling_algorithm": "random",
"objective": {
"goal": "minimize",
"primary_metric": "training_f1_score"
},
"search_space": {
"c_value": {
"type": "uniform",
"min_value": 0.5,
"max_value": 0.9
},
"kernel": {
"values": [
"rbf",
"linear",
"poly"
],
"type": "choice"
},
"coef0": {
"type": "uniform",
"min_value": 0.1,
"max_value": 1
}
},
"name": "sweep_step",
"display_name": null,
"tags": {},
"computeId": null,
"inputs": {
"data": {
"mode": "ReadOnlyMount",
"uri": "wasbs://datasets@azuremlexamples.blob.core.windows.net/iris.csv",
"job_input_type": "UriFile"
},
"c_value": {
"job_input_type": "Literal"
},
"kernel": {
"job_input_type": "Literal"
},
"degree": {
"job_input_type": "Literal",
"value": "3"
},
"gamma": {
"job_input_type": "Literal",
"value": "scale"
},
"coef0": {
"job_input_type": "Literal"
},
"shrinking": {
"job_input_type": "Literal",
"value": "False"
},
"probability": {
"job_input_type": "Literal",
"value": "False"
},
"tol": {
"job_input_type": "Literal",
"value": "0.001"
},
"cache_size": {
"job_input_type": "Literal",
"value": "1024"
},
"verbose": {
"job_input_type": "Literal",
"value": "False"
},
"max_iter": {
"job_input_type": "Literal",
"value": "-1"
},
"decision_function_shape": {
"job_input_type": "Literal",
"value": "ovr"
},
"break_ties": {
"job_input_type": "Literal",
"value": "False"
},
"random_state": {
"job_input_type": "Literal",
"value": "42"
}
},
"outputs": {},
"type": "sweep",
"trial": {
"componentId":
}
},
"predict_step": {
"environment_variables": {},
"name": "predict_step",
"display_name": null,
"tags": {},
"computeId": null,
"inputs": {
"model": {
"job_input_type": "Literal",
"value": "${{parent.jobs.sweep_step.outputs.model_output}}"
},
"test_data": {
"job_input_type": "Literal",
"value": "${{parent.jobs.sweep_step.outputs.test_data}}"
}
},
"outputs": {},
"resources": null,
"distribution": null,
"limits": null,
"componentId":
}
},
"outputs": {},
"settings": {
"default_compute":
}
}
}.
Object 'EXCLUDE' is not a valid value for the 'unknown' parameter
$> az --version
azure-cli 2.37.0
core 2.37.0
telemetry 1.0.6
Extensions:
ml 2.4.1
Dependencies:
msal 1.18.0b1
azure-mgmt-resource 21.1.0b1
Python location
Extensions directory
Python (Windows) 3.7.13 (default, Mar 28 2022, 08:03:21) [MSC v.1916 64 bit (AMD64)]
Legal docs and information: aka.ms/AzureCliLegal
Your CLI is up-to-date.
-
Contributor guide
Assessment
This issue has not been assessed yet.