microsoft / microsoft/rag-experiment-accelerator
AzureML pipeline: Ability to enable and disable steps
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 311
- Forks
- 111
- PR merge metrics
- No merged PRs in 30d
Description
...ability to run parts of the pipeline, for instance, you may want to run the indexing and QnA generation only once and experiment with many types of querying approaches. you may also skip QnA generation and use you own ground truth dataset.
Originally posted by @guybartal in https://github.com/microsoft/rag-experiment-accelerator/issues/343#issuecomment-2002603297
Add flags for enabling / disabling parts of the AzureML pipeline
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by locating the AzureML pipeline entry point and tracing the indexing, QnA generation, and querying stages described in the issue. Add a way to enable or disable those stages, including use of a supplied ground-truth dataset, and verify that each requested combination runs as intended.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- azure, python
- Domain
- cloud, machine-learning
- Issue type
- Feature
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100