learningequality / learningequality/studio

Determine partitioning strategy for content and file tables

Open
#3,325 0 comments 0 reactions 2 assignees View on GitHub

@rtibbles is already working on this.

Since Feb 15, 2022.

DEV: backend DEV: content TAG: performance TAG: research
Dominant language
Python
Stars
191
Forks
307
Avg merge
5d 6h
Merged PRs (30d)
10

Description

Current behavior

As studio usage has grown, database tables have grown to a size that makes performance optimization very difficult. The size makes queries or joins against these large tables very slow and therefore user operations to feel slow.

Desired outcomes

  • Determine a strategy for partitioning the ContentNode and File database tables:
    • How many buckets should we initially define for each?
    • What's the best field to partition the File table?
    • What's the best way to migrate to partitioned structures?
  • Perform some manual testing if possible

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.