finos / finos/common-cloud-controls

Release Service Testing "Packs" as Privateer Modules

Open
#997 0 comments 0 reactions 1 assignee Claimed by @robmoffat View on GitHub
delivery longstanding issue
Dominant language
Go
Stars
87
Forks
80
Avg merge
4d 15h
Merged PRs (30d)
13

Description

## Feature Request

### Description of Problem:

- We want people on the internet (inc. Microsoft and LSEG) to be able to pick up CCC and run it against an environment they own, and find out if the controls are met.
- We should do this as privateer modules, since these already exist and are fairly well documented.

### Potential Solutions:

- This should combine the Cloud Abstraction API, Cucumber testing scripts , Standard Cucumber Steps, privateer etc.
- and do automated releases.
- These will be consumed elsewhere within the CCC repo for testing CFI configurations that are set up.
- As well as producing HTML, OCSF, we should also output Gemara assessment results.

### Other Considerations

1. We shouldn't be setting up users in the test scripts. This should be up to the person using the scripts, and the different accounts should be provided as configuration. Same goes for permissioning the users. This will actually make the scripts simpler to write and run.
2. For things like "log destination" or "remote vpcs", we should be providing all of this in the configuration/ environment file for the test. That means, we are being really strict about which service we are testing.. but we are able to inspect other services to check the interactions are working correctly.
3. We should write a GitHub action using an LLM to generate the gherkin testing steps based on releases of either the abstraction layer or changes to CCC catalogs
4. We should have some automatic validation code that is able to check that all of the testing steps can run. (Essentially like a compiler).
5. We should separate out all the tests by service. At the moment, several of our core tests overlap, it's not completely ideal.

@santoshmaurya-0x6275696c6473

- #994
- #996

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.