microsoft / microsoft/winml-cli

P1-FEATURE-010: Build Report — Stage-by-Stage Build Summary

Open
#156 0 comments 0 reactions 1 assignee View on GitHub

@tezheng is already working on this.

Since Mar 31, 2026.

dev experience feature scale P1 triaged
Dominant language
Python
Stars
40
Forks
11
Avg merge
1d 8h
Merged PRs (30d)
50

Description

Summary

Implement a comprehensive build report that summarizes the full model build pipeline stage-by-stage, including metrics, EP compatibility results, and optimization summary.

Context

Users and developers need visibility into what happened during wmk build — how long each stage took, what the graph optimizer changed, and which EP is compatible. This report also serves as an audit artifact.

From plans/release/0501_release_plan/P0_CHECKLIST.md (P1-FEATURE-010).

Current State

  • wmk build produces console output but no structured report artifact
  • No per-stage timing or graph metrics
  • No EP compatibility analysis summary in build output

Desired State

  • wmk build saves artifacts/build_report.json with:
    • Stage timing: export, analyze, optimize, quantize (ms each)
    • Graph metrics: node count before/after each stage, op type distribution
    • EP compatibility: per-EP compatibility score from static analyzer
    • Optimization summary: nodes added/removed per pass
    • Errors: any non-fatal warnings or skipped stages

Acceptance Criteria

  • artifacts/build_report.json generated on every wmk build run
  • Stage timing recorded for all pipeline stages
  • Graph metrics: node count, op count by type, model size (MB) at each stage
  • EP compatibility results included (from static analyzer output)
  • Optimization summary: net node change, passes applied
  • Human-readable summary printed to console at build completion
  • Build report format documented
  • All existing tests pass

Technical Notes

  • Report schema: define a stable JSON schema (will be public API)
  • Console summary: print a table of stages + timing + key metrics
  • Must not break existing wmk build behavior — report is additive

Related Files

  • plans/release/0501_release_plan/feature-scale.md — P1.10 Build Report
  • plans/release/0501_release_plan/P0_CHECKLIST.md — P1-FEATURE-010

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.