AnswerDotAI / AnswerDotAI/RAGatouille

Improve Testing

Open
#48 0 comments 0 reactions 0 assignees View on GitHub
enhancement good first issue help wanted ongoing
Dominant language
Python
Stars
4k
Forks
276
PR merge metrics
No merged PRs in 30d

Description

Testing is currently very sparse. It's essentially just ensuring model loading works properly (not tested in all cases yet) and reproducing the notebooks as end2end tests to make sure a new version doesn't break indexing/searching or alter results.

This is an ongoing issue, with some objectives being:

1. Improve unit test coverage
2. Test every component of the data processing pipeline to ensure the training pipeline can be grown without breaking anything
3. Test model loading in a variety of circumstances
4. Just about anything else you can think of: it should be tested

Any contributions of even a single test would be very welcome!

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reviewing the existing model-loading tests and notebook-based end-to-end tests mentioned in the issue. Identify one focused gap in model loading or the data processing pipeline, add a test with a clear expected result, and run the relevant test suite to confirm it passes.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning, testing
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.