intermine / intermine/bluegenes

Hard limit to not fetch object IDs

Open
#692 0 comments 0 reactions 0 assignees View on GitHub
Discussion Medium priority performance Results page
Dominant language
Clojure
Stars
75
Forks
59
PR merge metrics
No merged PRs in 30d

Description

With #630, the performance of the results page for large results improved considerably, and with #582 it should improve even more.

The final bottleneck is that a query to fetch object IDs is still being run. It's not too bad though, as on a fast computer it's not noticeable until 50k+. A hard limit of 10k to disable fetching of object IDs (and thereby refrain from loading all tools and enrichment - preferably without providing an override) may be reasonable.

Contributor guide

Open the contributing guide

Research direction

Start at the results page and trace the query that fetches object IDs, then inspect how loading tools and enrichment depends on those IDs. The change is done when results above 10k stop fetching object IDs and do not load that related data, without an override.

Written by the indexing model from the issue text.

Assessment

Tech stack
clojure
Domain
performance
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.