microsoft/benchmark-qed

Automated benchmarking of Retrieval-Augmented Generation (RAG) systems

Stars: 98
Forks: 21
Open beginner issues: 0
Indexed issues: 9
Avg merge: 9m
Merged PRs (30d): 1

Dominant language: Python
License: MIT
Last GitHub push: Sep 18, 2026
Latest indexed: Sep 19, 2026
Contributing guide: No contributing guide
Code of conduct: Code of conduct
Beginner labels: No beginner labels indexed

Beginner friendly Everything

Open All

9 open issues indexed

Reference Answer Generation Open

Difficulty 4/5 3-5 days Newbie friendliness 45/100

microsoft/benchmark-qed#124 · Opened Sep 10, 2026
Copilot Client Integration and model access Open

enhancement

microsoft/benchmark-qed#120 · 1 assignee · Opened Aug 24, 2026
Benchmarking as part of Pull Request Workflows Open

enhancement github_actions

microsoft/benchmark-qed#119 · 1 assignee · Opened Aug 24, 2026
Agent and skill integration for automated benchmarking Open

enhancement

microsoft/benchmark-qed#118 · 1 assignee · Opened Aug 24, 2026
Implement cache mechanism improvements and parallelism support Open

enhancement

microsoft/benchmark-qed#117 · 1 comment · 1 assignee · Opened Aug 24, 2026
Deploy Centralized Benchmark Platform Open

enhancement

microsoft/benchmark-qed#116 · 1 assignee · Opened Aug 24, 2026
Implement UI changes to automate features with VS code in centralized Benchmark Platform Open

enhancement

microsoft/benchmark-qed#115 · 1 assignee · Opened Aug 24, 2026
Update GraphRAG to expand method signatures / functions to standardize Benchmark-QED code Open

enhancement

microsoft/benchmark-qed#114 · 1 assignee · Opened Aug 24, 2026
Implement absolute scoring method for benchmarking Open

enhancement

microsoft/benchmark-qed#113 · 1 comment · 1 assignee · Opened Aug 24, 2026

A short digest of beginner-friendly GitHub issues.