Add configuration options for pagination

**Description**
Currently api lacks proper caching support.

**Proposed solution**
Add configurable caching with sensible defaults.

**Priority**: Low/Medium

No files, tests, or entry points are named. Start by locating the API pagination and configuration code, then trace how responses are currently handled; done means caching is configurable and has sensible defaults, with the pagination behavior clarified and covered by appropriate tests.

Written by the indexing model from the issue text.