mlcommons/modelplane

View on GitHub

Stars: 6
Forks: 2
Open beginner issues: 0
Indexed issues: 25
Avg merge: 4m
Merged PRs (30d): 1

Dominant language: Python
License: Apache-2.0
Last GitHub push: Aug 21, 2026
Latest indexed: Sep 19, 2026
Contributing guide: Contributing guide
Code of conduct: No code of conduct
Beginner labels: No beginner labels indexed

Beginner friendly Everything

Open All

25 open issues indexed

Force upgrade modelbench in start up script Open

Difficulty 2/5 1-3 hours Newbie friendliness 35/100

mlcommons/modelplane#159 · Opened Jun 22, 2026
Documentation for metadata usage in end-to-end security DAG Open

mlcommons/modelplane#151 · 1 comment · 1 assignee · Opened Jun 9, 2026
Show stack trace for node errors Open

mlcommons/modelplane#149 · 1 assignee · Opened May 29, 2026
Add more debugging info to exceptions Open

Difficulty 3/5 1-2 days Newbie friendliness 30/100

mlcommons/modelplane#146 · Opened May 26, 2026
modelplane requirements Open

mlcommons/modelplane#145 · 1 assignee · Opened May 26, 2026
Fix DAG bug--safety arbiter looking at undecoded response Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

mlcommons/modelplane#141 · Opened May 20, 2026
Gracefully handle Composer node failures Open

mlcommons/modelplane#137 · 1 assignee · Opened May 14, 2026
Bijection decoder implementation Open

mlcommons/modelplane#135 · 1 assignee · Opened May 6, 2026
Write up documentation for security benchmark in modelplane-flights Open

mlcommons/modelplane#133 · 1 assignee · Opened May 5, 2026
Implement rot13 detector as part of rot13 decoder Open

mlcommons/modelplane#132 · 1 assignee · Opened May 5, 2026
modelplane minor cleanups Open

mlcommons/modelplane#131 · 1 assignee · Opened May 5, 2026
End-to-end security evaluator development notebook Open

mlcommons/modelplane#127 · 1 assignee · Opened Apr 29, 2026
Fixes needed for bijection decoder Open

mlcommons/modelplane#122 · 1 assignee · Opened Apr 21, 2026
Track run path per row for evaluator dags Open

Difficulty 4/5 3-5 days Newbie friendliness 30/100

mlcommons/modelplane#121 · Opened Apr 16, 2026
Implement refusal detector Open

mlcommons/modelplane#117 · 1 assignee · Opened Apr 15, 2026
FIrst pancake: DAGAnnotator Open

mlcommons/modelplane#110 · 1 assignee · Opened Mar 30, 2026
Evaluator development architecture Open

mlcommons/modelplane#108 · 1 comment · 1 assignee · Opened Mar 25, 2026
Fix mlflow deployment Open

mlcommons/modelplane#99 · 1 assignee · Opened Jan 13, 2026
Fix modelplane startup scripts Open

mlcommons/modelplane#94 · 1 assignee · Opened Dec 11, 2025
Make modelplane work with latest modelbench Open

mlcommons/modelplane#92 · 1 assignee · Opened Dec 8, 2025
Ensure mlflow can be cleanly updated Open

chore

mlcommons/modelplane#88 · 1 comment · 1 assignee · Opened Sep 30, 2025
Add script for test running Open

chore

mlcommons/modelplane#49 · 1 assignee · Opened Jul 8, 2025
modelplane support for json-based SUT uids Open

Difficulty 5/5 Over a week Newbie friendliness 15/100

mlcommons/modelplane#42 · Opened Jun 26, 2025
Add auth0 in front of the MLFlow server Open

Difficulty 5/5 Over a week Newbie friendliness 15/100

mlcommons/modelplane#38 · 2 comments · Opened Jun 25, 2025
Monitoring and Alerting for MLFlow server Open

Difficulty 5/5 Over a week Newbie friendliness 15/100

mlcommons/modelplane#37 · Opened Jun 25, 2025

mlcommons/modelplane

Get new issues in your inbox