TimelyDataflow / TimelyDataflow/differential-dataflow

Expose a named variant of `join_core` (mirroring `arrange_named`) for operator-level profiling

Open Beginner friendly
#770 2 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Rust
Stars
3k
Forks
211
Avg merge
10h 42m
Merged PRs (30d)
34

Description

Hi all, I noticed that arrangements can be given custom operator names via arrange_named / arrange_core(name), which is really helpful for identifying them in logging and profiling streams.

Joins don’t seem to have an equivalent right now: join_core hardcodes the operator name as "Join" (operators/join.rs:81), so every join shows up with the same name in OperatesEvent, making it hard to distinguish them in dataflows with many joins.

Would you be open to adding a named variant, e.g. join_core_named(other, name, logic), with join_core delegating to it using "Join"? It seems like a small backward-compatible change that mirrors arrange_named, and it would make profiling/debugging much easier.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with operators/join.rs:81 and compare its join_core implementation with arrange_named and arrange_core(name). Add the named join entry point while preserving join_core's default "Join" label, then verify that joins report distinct names in OperatesEvent and that existing behavior remains unchanged.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
observability
Issue type
Feature
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Quiet
Clarity
Clearly specified
Newbie friendliness
76/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.