vectordotdev / vectordotdev/vector

Remote integration tests

Open
#2,473 0 comments 1 reaction 0 assignees View on GitHub

Nobody has claimed this yet.

domain: tests meta: idea needs: approval
Dominant language
Rust
Stars
22.6k
Forks
2.3k
Avg merge
1d 7h
Merged PRs (30d)
146

Description

Testing against real-world, remote services, as opposed to local mock services, is something that keeps popping up in discussions:

  1. https://github.com/timberio/vector/pull/2412#issuecomment-620284867
  2. https://github.com/timberio/vector/pull/2222/files#diff-8c0f62c7b5cebce3dc01858e75b09369R1017
  3. https://github.com/timberio/vector/issues/2427

The hesitation centers around adding another test resource that we have to manage and maintain. I think we can reduce the burden if we:

  1. Limit remote integrations tests as much as possible. Keep them simple (it works or it doesn't) and lean into local unit tests for everything else.
  2. Have these remote test resources run 24/7 so we do not have to orchestrate provisioning and teardown. My hope is that this will make things simpler.
  3. Add a tests/terraform folder that makes it easy for anyone to provision these resources.

I'm curious what others think.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Review the linked discussions and the proposal for a tests/terraform folder first. The issue needs a decision on which remote services to support, how they should run continuously, and what provisioning workflow is expected before implementation can begin.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust, terraform
Domain
infrastructure, testing-qa
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.