microsoft / microsoft/finops-toolkit
[Open Data] Add tests to verify data
Open
Nobody has claimed this yet.
Skill: DevOps
Tool: Open data
- Dominant language
- PowerShell
- Stars
- 603
- Forks
- 248
- Avg merge
- 7d 11h
- Merged PRs (30d)
- 11
Description
⚠️ Problem
We need tests to validate that the data in open datasets is good and free of bugs.
🛠️ Solution
Create tests to validate scenarios for each dataset:
- Regions: Each row with the same RegionId should have the same RegionName
- Example hubs query:
Regions | summarize make_set(RegionName) by RegionId | where array_length(set_RegionName) != 1
- Example hubs query:
- Services: Each row with the same ServiceName should have the same ServiceCategory/Subcategory/etc
- Resource types: Do not include default portal links
- Resource types: Do not include "en-us" in any URLs
🙋♀️ Ask for the community
We could use your help:
- Please vote this issue up (👍) to prioritize it.
- Leave comments to help us solidify the vision.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the Regions Kusto example and identify where open-dataset validation tests belong. Add checks for consistent region and service fields, non-default portal links, and URLs without "en-us"; done means each listed dataset scenario is covered by a passing test.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- powershell
- Domain
- data, testing
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100