towardsthecloud / towardsthecloud/cloudburn
Add Bedrock and SageMaker idle capacity rules
Nobody has claimed this yet.
- Dominant language
- TypeScript
- Stars
- 1.8k
- Forks
- 371
- Avg merge
- 4h 32m
- Merged PRs (30d)
- 63
Description
What
Rules for idle ML capacity: Bedrock provisioned throughput with no invocations, and SageMaker Studio apps left running.
Why
Bedrock provisioned throughput (provisioned model units) is among the most expensive idle capacity on AWS today. Commitments run thousands of dollars per month per model unit whether invoked or not, and this is increasingly common as teams experiment with GenAI. SageMaker Studio kernel and app instances left running are the Studio-era version of the notebook-instance waste that CLDBRN-AWS-SAGEMAKER-1 already flags.
Details
- Bedrock provisioned throughput with zero or negligible invocations over the lookback window. Discovery only; new
bedrock/module,CLDBRN-AWS-BEDROCK-1. Confirm Resource Explorer support for provisioned model throughput. If it is unsearchable, use an account-level dataset per the existingcostguardrailspattern instead of a new Region fan-out. - SageMaker Studio app (
KernelGateway,JupyterServer, orCodeEditor) inInServicebeyond an idle threshold. Discovery only; extendssagemaker/asCLDBRN-AWS-SAGEMAKER-4.CLDBRN-AWS-SAGEMAKER-3is assigned to Savings Plans coverage in #200. - Optional: SageMaker endpoint on a real-time instance whose traffic fits serverless inference. Review severity; define the boundary with
CLDBRN-AWS-SAGEMAKER-2during research.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Review the existing costguardrails pattern and CLDBRN-AWS-SAGEMAKER-1 in the sagemaker/ module. Confirm whether Resource Explorer can discover Bedrock provisioned throughput; otherwise use the account-level dataset pattern, then extend sagemaker/ for idle InService Studio apps. Done means discovery-only rules for CLDBRN-AWS-BEDROCK-1 and CLDBRN-AWS-SAGEMAKER-4, with the optional endpoint case bounded against CLDBRN-AWS-SAGEMAKER-2.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- aws, typescript
- Domain
- cloud, machine-learning
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Quiet
- Clarity
- Mostly clear
- Newbie friendliness
- 48/100