Azure / Azure/MachineLearningNotebooks
increase scoring_timeout_ms
- 主要語言
- Jupyter Notebook
- 星號
- 4.4k
- 分支
- 2.6k
- PR 合併指標
- 30 天內沒有已合併 PR
描述
Hi,
the "scoring_time_out" has currently a max_limit of 300000 [ms]. Is it possible to increase that further? I created a WebService which trains models based on our Lab Data etc.. And for some products/materials the modelling will take more that 300s. Or is there a way to "bypass" the scoring_timeout_ms?
service = Webservice(name="ModellingWebService", workspace=ws)
service.update( inference_config=inference_config,
autoscale_enabled = True,
autoscale_target_utilization=50,
autoscale_min_replicas=1,
autoscale_max_replicas=10,
cpu_cores = 1,
cpu_cores_limit=6,
memory_gb = 3,
memory_gb_limit=20,
scoring_timeout_ms = 300000, #max 300s or update fails
max_request_wait_time = 15000)
Grüße
Marvin
---
#### Document Details
⚠ *Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.*
* ID: 2b1a7ca9-d49f-d32c-8b43-3e8fc9576815
* Version Independent ID: bc09c6bb-e989-14e6-5ab4-06a1fcd2f3a1
* Content: [azureml.core.webservice.aks.AksWebservice class - Azure Machine Learning Python](https://docs.microsoft.com/en-us/python/api/azureml-core/azureml.core.webservice.aks.akswebservice?view=azure-ml-py)
* Content Source: [AzureML-Docset/stable/docs-ref-autogen/azureml-core/azureml.core.webservice.aks.AksWebservice.yml](https://github.com/MicrosoftDocs/MachineLearning-Python-pr/blob/live/AzureML-Docset/stable/docs-ref-autogen/azureml-core/azureml.core.webservice.aks.AksWebservice.yml)
* Service: **machine-learning**
* Sub-service: **core**
* GitHub Login: @DebFro
* Microsoft Alias: **debfro**
貢獻指南
這個儲存庫沒有索引到貢獻指南
研究方向
從 AksWebservice 類別文件及其連結的來源 AzureML-Docset/stable/docs-ref-autogen/azureml-core/azureml.core.webservice.aks.akswebservice.yml 開始。檢查 scoring_timeout_ms 的文件說明,以及 300000 ms 的限制在哪裡強制執行;要完成此項工作,需要由 maintainer 確認的受支援變更或有文件記錄的替代方案。
由索引模型根據 Issue 內容生成。
評估
- 技術堆疊
- azure, jupyter-notebook, python
- 領域
- cloud, machine-learning
- Issue 類型
- 功能
- 難度
- 5/5
- 預估耗時
- 一週以上
- 活躍度
- 停滯
- 描述清晰度
- 需要釐清
- 新手友好度
- 25/100