HydrologicEngineeringCenter / HydrologicEngineeringCenter/cwms-python
Change TS Multi to a Larger Page Size
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 16
- Forks
- 11
- Avg merge
- 4d 6h
- Merged PRs (30d)
- 8
Description
With
https://github.com/USACE/cwms-data-api/pull/1692
Newer versions of CDA will be able to handle much larger page-sizes.
Speaking with @msweier we agreed that it makes sense to increase the default page size. change how the date chunking works to support larger page sizes.
This is because a single larger call can return faster than many smaller calls.
You do not have to deal with the overhead each thread has and each http call must make with multiple parallel calls.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by tracing the TS Multi date-chunking implementation and read PR #1692 to understand the larger page-size support in newer CDA versions. Determine how chunk boundaries and parallel requests are currently handled. Done means larger requests use fewer date chunks and preserve the existing results and behavior.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- api, backend, performance
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Active
- Clarity
- Mostly clear
- Newbie friendliness
- 48/100