microsoft/P.808

View on GitHub

This is an open-source implementation of the ITU P.808 standard for "Subjective evaluation of speech quality with a crowdsourcing approach" (see https://www.itu.int/rec/T-REC-P.808/en). It uses Amazon Mechanical Turk as the crowdsourcing platform. It includes implementations for Absolute Category Rating (ACR), Degradation Category Rating (DCR), and Comparison Category Rating (CCR).

Stars: 230
Forks: 61
Open beginner issues: 0
Indexed issues: 14

Dominant language: HTML
License: MIT
Last GitHub push: Aug 18, 2026
Latest indexed: Sep 19, 2026
Contributing guide: No contributing guide
Code of conduct: Code of conduct
Beginner labels: No beginner labels indexed
PR merge metrics: No merged PRs in 30d

Beginner friendly Everything

Open All

14 open issues indexed

Cannot Play Audio in P.835 HIT on MTurk Sandbox (Network shows 206 Status) Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

microsoft/P.808#75 · 1 comment · Opened May 1, 2025
Balanced block design gets reshuffled in ccr test. Open

Difficulty 2/5 1-3 hours Newbie friendliness 48/100

microsoft/P.808#64 · 1 comment · Opened Jan 30, 2023
Data cleaning should remove raters with low acceptance rates Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

microsoft/P.808#55 · Opened Mar 22, 2022
Implement improved method to limit turkers rating > max HITS Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

microsoft/P.808#54 · Opened Mar 22, 2022
AzureClipStorage breaks if one directory name is prefix of another Open

Difficulty 2/5 1-3 hours Newbie friendliness 45/100

microsoft/P.808#52 · Opened Jan 13, 2022
P.808/docs/prep_p835.md Open

Difficulty 2/5 1-3 hours Newbie friendliness 25/100

microsoft/P.808#38 · Opened Mar 2, 2021
gold questions are not evaluated in p.835 (post processing) Open

Difficulty 4/5 3-5 days Newbie friendliness 15/100

microsoft/P.808#22 · Opened Oct 11, 2020
validity check for "bonus" settings in the configuration Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

microsoft/P.808#14 · Opened Sep 2, 2020
condition_pattern (regex) Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

microsoft/P.808#13 · 1 comment · Opened Jul 21, 2020
importing libraries for azure.blob needs to be updated in master_script.py Open

Difficulty 1/5 Under an hour Newbie friendliness 72/100

microsoft/P.808#12 · Opened Jul 9, 2020
Document Azure support for P.808 Open

microsoft/P.808#5 · 4 comments · 1 assignee · Opened Mar 26, 2020
Need solution to get target # of ratings per hit Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

microsoft/P.808#4 · Opened Mar 5, 2020
Document regular expressions in result_parser.py Open

microsoft/P.808#3 · 1 assignee · Opened Mar 5, 2020
Add aggregation analysis to result_parser.py Open

microsoft/P.808#2 · 1 assignee · Opened Mar 5, 2020

microsoft/P.808

Get new issues in your inbox