Azure ML pipeline

Open
#326 0 comments 1 reaction 1 assignee View on GitHub

@tanya-borisova is already working on this.

Since Mar 4, 2024.

Assessment

This issue has not been assessed yet.

Description

Implement running the steps of RAG Experiment Accelerator in an AzureML pipeline.

This will achieve:

  • Being able to start several experiments in parallel, rather than sequentially
  • Perform the indexing step of an experiment in parallel, as this is the slowest step

Design diagram
AzureMLPipeline drawio

### Tasks
- [ ] https://github.com/microsoft/rag-experiment-accelerator/issues/342
- [ ] https://github.com/microsoft/rag-experiment-accelerator/issues/413
- [ ] https://github.com/microsoft/rag-experiment-accelerator/issues/402
- [ ] https://github.com/microsoft/rag-experiment-accelerator/issues/403
- [ ] https://github.com/microsoft/rag-experiment-accelerator/issues/411
- [ ] https://github.com/microsoft/rag-experiment-accelerator/issues/435
Dominant language
Python
Stars
311
Forks
111
No merged PRs in 30d

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from microsoft/rag-experiment-accelerator

All issues in microsoft/rag-experiment-accelerator

Similar issues

More Python issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.