aws / aws/sagemaker-python-sdk

How to change default values in constraints generated by baselines (`sagemaker.model_monitor.***.suggest_baseline()`)

未关闭
#2,628 0 条评论 1 个 reaction 已指派 1 人 已被 @rsareddy0329 认领 在 GitHub 查看
type: documentation type: question
主要语言
Python
星标
2.3k
派生
1.3k
平均合并
1 天 22 小时
30 天内合并 PR
35

描述

**What did you find confusing? Please describe.**
I have failed to find any documentation that let me change the default values in constraints.json that
[`sagemaker.model_monitor.DefaultModelMonitor.suggest_baseline()`](https://sagemaker.readthedocs.io/en/stable/api/inference/model_monitor.html?highlight=DefaultModelMonitor#sagemaker.model_monitor.model_monitoring.DefaultModelMonitor.suggest_baseline) saves to S3 after a processing job. one of the constraints that I would like to change are `domain_content_threshold` from `0.1` to `0.25`.

**Describe how documentation can be improved**
Provide documentation to change the default values of multiple constraints from [constraints.json file](https://docs.aws.amazon.com/sagemaker/latest/dg/model-monitor-byoc-constraints.html) in documentation for each of the `suggest_baseline` methods (I meant methods from `sagemaker.model_monitor.***`). And also let users use custom code(or a python function) for `comparison_method` in `distribution_constraints`. Having to bring custom container for one modification from sagemaker defaults is not optimal and time consuming for users to build. Moreover, sagemaker's model-analyzer images are not public anyway (or I haven't been able to pull pull them to local docker) for users to able to improve upon or change couple of things to suit their needs.

**Additional context**
Add any other context or screenshots about the documentation request here.

贡献指南

打开贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。