tutorials/nemo-retriever-synthetic-data-generation: ETA for Training Data Generation Example

https://github.com/NVIDIA-NeMo/Curator/tree/v0.9.0/tutorials/nemo-retriever-synthetic-data-generation

This version supports the generation of evaluation datasets, creating synthetic benchmark datasets compatible with commonly used evaluation frameworks such as BEIR. Synthetic training dataset generation will be supported in an upcoming version.

Hello @vinay-raman

Could you please help clarify the following:

• What are the key differences between synthetic datasets intended for evaluation and those intended for training in the context of embedding-model fine-tuning?
• For the upcoming synthetic training dataset feature, what format do you plan to produce (e.g., positive/negative pairs, triplets with hard negatives, qrels), and will example notebooks or tutorials be provided?
• Is there an estimated timeline for when the synthetic training dataset generation example will be available?

Thank you very much for your guidance and support.

Start with the linked tutorials/nemo-retriever-synthetic-data-generation example at the v0.9.0 tag and compare its evaluation-dataset scope with the requested training-data use case. The issue is complete only when the project provides or documents the training-data format, example materials, and availability timeline; no implementation entry point is specified.