Improve api performance

**Feature request**
It would be great to have pagination for parsers.

**Use case**
Many users need this functionality for production deployments.

**Implementation idea**
Add a new config option `enable_pagination` with default `false`.

Start by locating the parser entry points, API handling, and configuration loading for the proposed enable_pagination option. Define how paginated parser results should behave when enabled, confirm the default preserves current behavior, and add or run relevant API checks if the project provides them.

Written by the indexing model from the issue text.