tensorflow / tensorflow/tensorboard

Scaling to very large numbers of tags within the scalar dashboard

Open
#4,170 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
TypeScript
Stars
7.2k
Forks
1.7k
Avg merge
4d 22h
Merged PRs (30d)
1

Description

TensorBoard is capable of presenting runs with 10k+ tags, but is very slow when doing so.

I created a logdir with a single run with 12,345 tags. Each tag contains a single scalar. Loading the frame of the page was quick, but there it hung until the list of scalar tags was loaded. This took 1.6 minutes

I've uploaded the logdir to 12345tags.zip and attached to this github issue.
12345tags.zip

image
__
Screen Shot 2020-09-16 at 3 58 43 PM

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Reproduce the issue with the attached 12,345-tag logdir and inspect the scalar dashboard path that loads the list of scalar tags. Measure the loading step that takes 1.6 minutes and trace it to the relevant frontend entry point. Done means the scalar dashboard loads the large tag set substantially faster without regressing normal tag lists.

Written by the indexing model from the issue text.

Assessment

Tech stack
typescript
Domain
frontend, performance
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.