Optimize config for large datasets

**Description**
Currently data lacks proper caching support.

**Proposed solution**
Add configurable caching with sensible defaults.

**Priority**: Low/Medium

No files, tests, or entry points are named. Start by locating the data-processing path and current configuration handling, then inspect how large datasets are loaded and whether any caching exists. Done means caching is configurable, has documented sensible defaults, and its behavior is verified for large datasets.

Written by the indexing model from the issue text.