open-feature / open-feature/flagd
[CHORE] Review gherkin suite and test-harness for missing test coverage
Nobody has claimed this yet.
- Dominant language
- Go
- Stars
- 998
- Forks
- 136
- Avg merge
- 4d 8h
- Merged PRs (30d)
- 11
Description
Our testbed covers all our operators, and some behavior around connection and re-connection. The goal of this issue is to identify and enumerate shortcomings in this suite which can be tackled in other issue(s).
For example (not sure if any of these are ACTUALLY missing or not):
- missing edge cases for custom operations (
fraction,sem_ver, etc) - missing tests for built-in JsonLogic operators
- missing test cases for provider misconfiguration
- missing test cases for error scenarios
Tips:
- Review https://github.com/open-feature/flagd-testbed/tree/main/flags, which contains all the flags in the testbed. Make sure the flags here exercise all possible operators and their key use-cases
- Review https://github.com/open-feature/flagd-testbed/tree/main/gherkin, which contains the tests/assertions, and make sure all the assertions are robust and all functionality is represented
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reviewing the flagd-testbed flags directory, then inspect its gherkin directory and assertions. Compare the covered operators, connection and reconnection behavior, provider configuration, and error scenarios against the stated examples. Done means producing an enumeration of missing or weak coverage that can be addressed in follow-up issues.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- go
- Domain
- testing-qa
- Issue type
- Refactor
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100