Enhancement: Add Tests for Large Dataset Scenarios

Issue Description

Currently, there are no test cases implemented to handle large dataset scenarios. We need to add tests that simulate the handling of large datasets in the API, especially for cases where thousands or more records are involved. This is important to ensure the system performs efficiently and correctly under such scenarios.

Expected Behavior

The system should be able to handle large datasets without performance degradation or errors. The new tests should simulate the handling of a high volume of data, ensuring API reliability and responsiveness.

Current Behavior

Currently, no tests are available for large dataset scenarios.

Reproducibility

• This issue is reproducible
• This issue is not reproducible

Severity/Priority

• Critical
• High
• Medium
• Low

Additional Information

• The current test suite does not cover large-scale data handling, which could impact system performance during real-world scenarios.
• We should also define what scale qualifies as a "large dataset" (e.g., tens of thousands of records).

Checklist

• I have read and followed the project's code of conduct.
• I have searched for similar issues before creating this one.
• I have provided all the necessary information to understand and reproduce the issue.
• I am willing to contribute to the resolution of this issue.

Start by examining the existing API test suite and the relevant API entry points to determine how test data is created and requests are exercised. Define what qualifies as a large dataset, then add tests covering thousands or more records and verify correctness, reliability, responsiveness, and the agreed performance criteria.