microsoft / microsoft/finops-toolkit

[Open Data] Add tests to verify data

Open
#1,432 0 comments 1 reaction 0 assignees View on GitHub

Nobody has claimed this yet.

Skill: DevOps Tool: Open data
Dominant language
PowerShell
Stars
603
Forks
248
Avg merge
7d 11h
Merged PRs (30d)
11

Description

⚠️ Problem

We need tests to validate that the data in open datasets is good and free of bugs.

🛠️ Solution

Create tests to validate scenarios for each dataset:

  • Regions: Each row with the same RegionId should have the same RegionName
    • Example hubs query:
      Regions 
      | summarize make_set(RegionName) by RegionId 
      | where array_length(set_RegionName) != 1
      
  • Services: Each row with the same ServiceName should have the same ServiceCategory/Subcategory/etc
  • Resource types: Do not include default portal links
  • Resource types: Do not include "en-us" in any URLs

🙋‍♀️ Ask for the community

We could use your help:

  1. Please vote this issue up (👍) to prioritize it.
  2. Leave comments to help us solidify the vision.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the Regions Kusto example and identify where open-dataset validation tests belong. Add checks for consistent region and service fields, non-default portal links, and URLs without "en-us"; done means each listed dataset scenario is covered by a passing test.

Written by the indexing model from the issue text.

Assessment

Tech stack
powershell
Domain
data, testing
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.