vectordotdev / vectordotdev/vector
Remote integration tests
Open
Nobody has claimed this yet.
domain: tests
meta: idea
needs: approval
- Dominant language
- Rust
- Stars
- 22.6k
- Forks
- 2.3k
- Avg merge
- 1d 7h
- Merged PRs (30d)
- 146
Description
Testing against real-world, remote services, as opposed to local mock services, is something that keeps popping up in discussions:
- https://github.com/timberio/vector/pull/2412#issuecomment-620284867
- https://github.com/timberio/vector/pull/2222/files#diff-8c0f62c7b5cebce3dc01858e75b09369R1017
- https://github.com/timberio/vector/issues/2427
The hesitation centers around adding another test resource that we have to manage and maintain. I think we can reduce the burden if we:
- Limit remote integrations tests as much as possible. Keep them simple (it works or it doesn't) and lean into local unit tests for everything else.
- Have these remote test resources run 24/7 so we do not have to orchestrate provisioning and teardown. My hope is that this will make things simpler.
- Add a
tests/terraformfolder that makes it easy for anyone to provision these resources.
I'm curious what others think.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Review the linked discussions and the proposal for a tests/terraform folder first. The issue needs a decision on which remote services to support, how they should run continuously, and what provisioning workflow is expected before implementation can begin.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- rust, terraform
- Domain
- infrastructure, testing-qa
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100