AnswerDotAI / AnswerDotAI/RAGatouille
Improve Testing
- Dominant language
- Python
- Stars
- 4k
- Forks
- 276
- PR merge metrics
- No merged PRs in 30d
Description
Testing is currently very sparse. It's essentially just ensuring model loading works properly (not tested in all cases yet) and reproducing the notebooks as end2end tests to make sure a new version doesn't break indexing/searching or alter results.
This is an ongoing issue, with some objectives being:
1. Improve unit test coverage
2. Test every component of the data processing pipeline to ensure the training pipeline can be grown without breaking anything
3. Test model loading in a variety of circumstances
4. Just about anything else you can think of: it should be tested
Any contributions of even a single test would be very welcome!
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by reviewing the existing model-loading tests and notebook-based end-to-end tests mentioned in the issue. Identify one focused gap in model loading or the data processing pipeline, add a test with a clear expected result, and run the relevant test suite to confirm it passes.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning, testing
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100