tensorflow / tensorflow/tensorboard

Embedding projector only loads first 100,000 vectors

Open
#773 17 comments 7 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

plugin:projector stat:contributions welcome theme:performance
Dominant language
TypeScript
Stars
7.2k
Forks
1.7k
Avg merge
4d 22h
Merged PRs (30d)
1

Description

Embedding projector only loads first 100000 vectors. In many real world applications, embedding dictionaries are well over 1Mil. Need some way to display vectors from larger sets or at least have a way to configure what the upper limit is.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by locating the embedding projector code that enforces the 100000-vector limit and trace how vector data is loaded and displayed. Define whether completion means supporting larger dictionaries, exposing a configurable upper bound, or both, then verify the projector handles datasets above the current limit.

Written by the indexing model from the issue text.

Assessment

Tech stack
typescript
Domain
data-visualization
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.