prometheus / prometheus/compliance

Allow running tests against specific opentelemetry collector binary

Open
#97 0 comments 1 reaction 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Go
Stars
158
Forks
54
PR merge metrics
No merged PRs in 30d

Description

According to the documentation, if we want to test a development version of the target of the remote_write_sender tests, we have to copy the binary in the bin directory.

Right now most of the targets of tests are hard coded to a specific version and the binary that will be used in the tests will use the name of the artifact published and copy the content in the bin directory. However this is not stable as the filename will usually contain the version e.g.: otelcol_0.42.0_linux_amd64

I'm proposing that we use the filename in archive instead of deriving the filename from the published artifact, since this will be more stable.

Alternative approach:

Allow to use different binaries for tests based on environment variables. We could stablish a convention for environment variables that could be used by all targets.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with remote_write_sender/README.md and the documented bin directory, then inspect how remote_write_sender tests derive target binary names from published artifacts. The work is done when tests can use a specific OpenTelemetry Collector binary without relying on a version-derived filename, using either the archive filename or a documented environment-variable convention.

Written by the indexing model from the issue text.

Assessment

Tech stack
go
Domain
testing-qa, tooling
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.