Pulp List Domain Endpoint is slow

Open
#5,979 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
4/5
Estimated time
3-5 days
Newbie friendliness
35/100
Issue type
Bug
Clarity
Needs clarification
Activity status
Stale
Tech stack
python
Domain
api, backend, performance

Research direction

Start at the Pulp list-domains endpoint and reproduce the staging profile described in the issue. Inspect the serializer data path, database cursor execution, and field decryption identified by the profile. Done should address the reported runtime hotspots and confirm the endpoint remains correct by comparing profiling results.

Written by the indexing model from the issue text.

Description

Issue

CProfile List Domains Endpoint

In looking at the list domains endpoint, there are 60ish domains in the system, but the list is set to limit to 25.

Here are 3 of the main areas where time is spent that I can see:

40.51% serializers:793:data       <----   This is the serializing the individual fields and the entire request
5.55% cursor:80:execute       <----    This is the actual DB cursor wait time. If you consider the calls above as necessary overhead to get here it's more like 8%. Note (and interestingly) this is not a subcomponent of the serializer time above
34.67% fields:136:decrypt       <----   This is just the time spent decrypting the fields!

Dennis and I put this analysis together based on data he collected against our staging environment.

cprofile list domains

Dominant language
Python
Stars
598
Forks
168
Avg merge
1d 4h
Merged PRs (30d)
86

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from pulp/pulpcore

All issues in pulp/pulpcore

Similar issues

More Python issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.