opensafely-core / opensafely-core/backend-server

use the otel-collector on tpp backend to buffer jobrunner telemetry

Open
#167 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Shell
Stars
1
Forks
5
Avg merge
1h 36m
Merged PRs (30d)
2

Description

  • we already have an otel-collector on the tpp-backend which collects system metrics & sends them to otel-gateway (the otel-collector on dokku4)
  • traces/spans from job-runner currently go directly to otel-gateway, but they can be buffered in process in job-runner & the buffer contents can be lost if job-runner is restarted
  • we should send the trace data from job-runner to the otel-collector to forward on to otel-gateway

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by locating the tpp-backend otel-collector configuration and the job-runner trace export configuration, then trace how data reaches the otel-gateway. Confirm the collector can receive job-runner traces and forward them onward; done means job-runner telemetry uses that path and no longer sends directly to the gateway.

Written by the indexing model from the issue text.

Assessment

Domain
infrastructure, observability
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.