Azure / Azure/arm-ttk

Custom test cases should be easy to add

Open
#329 0 comments 2 reactions 0 assignees View on GitHub
enhancement
Dominant language
PowerShell
Stars
468
Forks
208
PR merge metrics
No merged PRs in 30d

Description

While the current framework supports custom test cases, it does not do so in a way that is user-friendly.

Test-AzTemplate -TestCase/-TestGroup will allow you to pass a dictionary of additional test cases and groups.

-TestCase should contain the name/ScriptBlock or Path to test
-TestGroup should contain the list of tests in each group.
Where things get annoying is that while -TestCase is additive, -TestGroup overwrites. Ergo providing your own test cases _and_ using the built in ones would be annoying.

This could be made more elegant by having something like a -TestDirectory parameter, which would read an additional directory tree's worth of tests (containing it's own /deploymentTemplate and /createUIDefinition subfolders).

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the Test-AzTemplate handling for -TestCase and -TestGroup. Define how an additional -TestDirectory tree containing deploymentTemplate and createUIDefinition tests should combine with built-in tests, and consider the behavior complete when custom tests and groups can be added without replacing the built-in ones.

Written by the indexing model from the issue text.

Assessment

Tech stack
powershell
Domain
testing-qa
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.