temporalio / temporalio/sdk-java

Missing metric reporting in local activity execution

Open
#2,119 2 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Java
Stars
433
Forks
249
Avg merge
5d 6h
Merged PRs (30d)
26

Description

Expected Behavior

  • temporal_activity_succeed_endtoend_latency
  • temporal_local_activity_execution_failed
    are emitted correctly

Actual Behavior

They are missing in our production
Screenshot 2024-06-20 at 1 44 16 PM

You can see in the graph that the LA execution metrics are reported but not end to end. In fact, this is happening most of the time.
We also pretty sure there are many cases of LA execution failure but not reported based on our workflow history.

Steps to Reproduce the Problem

NA

Specifications

  • Version: 1.22.3
  • Platform:

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by tracing where the named local activity metrics, temporal_activity_succeed_endtoend_latency and temporal_local_activity_execution_failed, are emitted in the Java SDK. Compare those paths with the reported local activity execution metrics and verify behavior against workflow history; done means the missing success and failure metrics are emitted consistently.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
observability
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.