Optimize auth for large datasets

**Description**
Currently lib lacks proper filtering support.

**Proposed solution**
Add configurable filtering with sensible defaults.

**Priority**: Low/Medium

Start by locating the authentication and library filtering code mentioned in the issue, then determine how large datasets are currently handled. Define the configurable filtering behavior and sensible defaults, and verify that authentication still works correctly with both default and customized filters.

Written by the indexing model from the issue text.