TimelyDataflow/differential-dataflow

View on GitHub

An implementation of differential dataflow using timely dataflow on Rust.

Stars: 3k
Forks: 211
Open beginner issues: 0
Indexed issues: 90
Avg merge: 10h 42m
Merged PRs (30d): 34

Dominant language: Rust
License: MIT
Last GitHub push: Jul 29, 2026
Latest indexed: Sep 20, 2026
Contributing guide: Contributing guide
Code of conduct: No code of conduct
Beginner labels: No beginner labels indexed

Beginner friendly Everything

Open All

90 issues indexed so far

Workflow "Test build against Timely master" failed Open

build-failure

Difficulty 4/5 3-5 days Newbie friendliness 35/100

TimelyDataflow/differential-dataflow#839 · Opened Aug 19, 2026
reduce driver: late empty batches can transiently regress upper_limit (hardening follow-up from #801) Open

Difficulty 4/5 3-5 days Newbie friendliness 48/100

TimelyDataflow/differential-dataflow#806 · Opened Jul 17, 2026
Expose a named variant of `join_core` (mirroring `arrange_named`) for operator-level profiling Open

Difficulty 2/5 1-3 hours Newbie friendliness 76/100

TimelyDataflow/differential-dataflow#770 · 2 comments · Opened Jun 24, 2026
Provenance/Explanation Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

TimelyDataflow/differential-dataflow#742 · 15 comments · 2 reactions · Opened May 17, 2026
Prefetch hints for arrangement reads (joins, reduces) Open

Difficulty 5/5 Over a week Newbie friendliness 38/100

TimelyDataflow/differential-dataflow#716 · 1 comment · 1 reaction · Opened Apr 9, 2026
Expose pointer to memory in BatchFrontier/BatchReader/BatchContainer/Cursor? Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

TimelyDataflow/differential-dataflow#658 · 2 comments · Opened Jan 20, 2026
Workflow "Test build against Timely master" failed Open

build-failure

Difficulty 3/5 1-2 days Newbie friendliness 35/100

TimelyDataflow/differential-dataflow#646 · Opened Sep 18, 2025
All algorithms should be usable with generic containers Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

TimelyDataflow/differential-dataflow#622 · 1 comment · Opened Jul 11, 2025
Allow containers on half-join's stream input Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

TimelyDataflow/differential-dataflow#621 · Opened Jul 11, 2025
Reduce operator (and others) may be quadratic with deep history Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

TimelyDataflow/differential-dataflow#618 · Opened Jul 7, 2025
Trace import in an iterative context appears to create downgrade loop Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

TimelyDataflow/differential-dataflow#598 · 3 comments · Opened Apr 21, 2025
Add a CHANGELOG.md to dogsdogsdogs Open

TimelyDataflow/differential-dataflow#576 · 1 assignee · Opened Feb 19, 2025
Improve clarity around `Cursor` method requirements Open

TimelyDataflow/differential-dataflow#513 · 1 assignee · Opened Jun 11, 2024
Suggestion: WebAssembly support Open

Difficulty 5/5 Over a week Newbie friendliness 28/100

TimelyDataflow/differential-dataflow#479 · 22 comments · 1 reaction · Opened Apr 29, 2024
Arrangement batch formation costs in proportion to outstanding updates Open

Difficulty 5/5 Over a week Newbie friendliness 30/100

TimelyDataflow/differential-dataflow#460 · 3 comments · Opened Feb 19, 2024
Revisit the stashing logic in MergeBatcherColumnation Open

TimelyDataflow/differential-dataflow#426 · 1 assignee · Opened Nov 23, 2023
maybe the doc should add some instructions at geting started section Open

Difficulty 2/5 1-3 hours Newbie friendliness 48/100

TimelyDataflow/differential-dataflow#406 · 1 reaction · Opened Aug 28, 2023
Question: how to change data timestamp for late arriving data Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

TimelyDataflow/differential-dataflow#400 · 4 comments · Opened Jun 30, 2023
Holding on to a trace with physical/logical compaction to the empty frontier stalls compaction Open

Difficulty 4/5 3-5 days Newbie friendliness 20/100

TimelyDataflow/differential-dataflow#398 · Opened Jun 26, 2023
Operator to flatten `Collection<Collection<G, D, R>>` into `Collection<G, D, R>` Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

TimelyDataflow/differential-dataflow#372 · Opened Nov 12, 2022
what different with flink Retraction Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

TimelyDataflow/differential-dataflow#357 · 3 reactions · Opened Mar 10, 2022
Consolidate Timestamps and Time Windowed Dataflows Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

TimelyDataflow/differential-dataflow#351 · Opened Jan 10, 2022
Consider using `RefOrMut` in `half_join` Open

Difficulty 5/5 Over a week Newbie friendliness 30/100

TimelyDataflow/differential-dataflow#343 · Opened Oct 6, 2021
Question about some codes in `arrangement.rs` Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

TimelyDataflow/differential-dataflow#333 · Opened Aug 2, 2021
Trace imports are invisible Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

TimelyDataflow/differential-dataflow#330 · 4 comments · Opened Jul 8, 2021
Present lower-level operator interfaces Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

TimelyDataflow/differential-dataflow#326 · Opened May 19, 2021
Conditionally return object if related to subject via pattern Open

Difficulty 5/5 Over a week Newbie friendliness 15/100

TimelyDataflow/differential-dataflow#315 · Opened Mar 10, 2021
Audit operator code for "overload protection" Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

TimelyDataflow/differential-dataflow#302 · Opened Jan 29, 2021
Consider `Tombstone` trait for `Diff` Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

TimelyDataflow/differential-dataflow#298 · 3 reactions · Opened Jan 25, 2021
Clarify how Variables work Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

TimelyDataflow/differential-dataflow#286 · 1 comment · Opened Nov 6, 2020
Aggregating collection into a single value Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

TimelyDataflow/differential-dataflow#276 · Opened Aug 8, 2020
Is this general purpose incremental framework? Open

Difficulty 5/5 Over a week Newbie friendliness 15/100

TimelyDataflow/differential-dataflow#275 · 1 comment · Opened Jun 28, 2020
Access to "history" of each value? Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

TimelyDataflow/differential-dataflow#274 · Opened Jun 18, 2020
Better Scaling for Parallel Workers Open

Difficulty 5/5 Over a week Newbie friendliness 15/100

TimelyDataflow/differential-dataflow#273 · Opened Jun 17, 2020
`wrapper/frontier.rs` does not update metadata Open

Difficulty 3/5 1-2 days Newbie friendliness 55/100

TimelyDataflow/differential-dataflow#271 · Opened May 12, 2020
Extracting arrangement from `threshold_total` Open

Difficulty 5/5 Over a week Newbie friendliness 30/100

TimelyDataflow/differential-dataflow#269 · 2 comments · Opened May 3, 2020
Relaxing `Default` trait bound in dogs^3. Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

TimelyDataflow/differential-dataflow#261 · 3 comments · Opened Mar 10, 2020
Fuel tank for all differential operators (potentially) Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

TimelyDataflow/differential-dataflow#260 · 2 comments · Opened Mar 9, 2020
Arrange operator does not compact trace on dataflow shutdown. Open

Difficulty 4/5 3-5 days Newbie friendliness 45/100

TimelyDataflow/differential-dataflow#250 · Opened Feb 12, 2020
Memory allocation in Differential Dataflow Open

Difficulty 5/5 Over a week Newbie friendliness 15/100

TimelyDataflow/differential-dataflow#249 · 3 comments · Opened Feb 11, 2020
Wrong `since` frontier for merged batch? Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

TimelyDataflow/differential-dataflow#247 · 5 comments · Opened Feb 7, 2020
Wrong check? Open

Difficulty 2/5 1-3 hours Newbie friendliness 42/100

TimelyDataflow/differential-dataflow#246 · 1 comment · Opened Jan 18, 2020
Allow `import` operator to shut down at frontier Open

Difficulty 5/5 Over a week Newbie friendliness 30/100

TimelyDataflow/differential-dataflow#238 · Opened Dec 3, 2019
Cryptic error messages when working with custom types Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

TimelyDataflow/differential-dataflow#228 · 3 comments · Opened Nov 18, 2019
Clarification regarding compaction in DD Open

Difficulty 5/5 Over a week Newbie friendliness 15/100

TimelyDataflow/differential-dataflow#227 · 2 comments · Opened Nov 14, 2019
`.inspect()`-ing a collection after the dataflow has been created. Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

TimelyDataflow/differential-dataflow#218 · 4 comments · Opened Oct 1, 2019
enter_at is specialized to Product scopes Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

TimelyDataflow/differential-dataflow#217 · Opened Sep 16, 2019
Collections with primary key can support more efficient cursors Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

TimelyDataflow/differential-dataflow#212 · Opened Aug 30, 2019
Implement `distinct` for arrangements by key and value. Open

Difficulty 4/5 3-5 days Newbie friendliness 42/100

TimelyDataflow/differential-dataflow#208 · 1 comment · Opened Aug 28, 2019
Several implicit commutativity assumptions Open

Difficulty 3/5 1-2 days Newbie friendliness 38/100

TimelyDataflow/differential-dataflow#192 · 18 comments · Opened Jul 26, 2019

TimelyDataflow/differential-dataflow

Get new issues in your inbox