InsightSoftwareConsortium / InsightSoftwareConsortium/ITKSphinxExamples

Inconsistent Output Baseline Comparisons

オープン
#212 コメント 1 件 リアクション 1 件 担当者 1 名 @mseng10 が担当を希望しています GitHub で見る
主要言語
Jupyter Notebook
スター
59
フォーク
70
平均マージ
1日 15時間
マージ済み PR(30日)
12

説明

## Description
After fixing a number of failing tests in the recent weeks, I came across some inconsistencies in the baseline test cases. Essentially, all of the baseline comparisons that compare an image without the name `OutputBaseline`, are incorrectly comparing results. An example can be found in the `AddNoiseToBinaryImageTestBaselineComparison`, which produces:
```
/Users/mseng_l/ITKExamples-build/bin/ImageCompareCommand "--test-image"
"/Users/mseng_l/ITKExamples-build/src/Core/Common/AddNoiseToBinaryImage/AddNoiseToBinaryImage.png" "--baseline-image"
"/Users/mseng_l/ITKExamples-build/src/Core/Common/AddNoiseToBinaryImage/AddNoiseToBinaryImage.png"
```
-------------

As shown above, the baseline comparison is not comparing the example's output to the baseline image, but rather the baseline image to itself, which will always yield a passing result.

This and many others will likely require one of the following changes:
- [ ] Remove baseline comparisons for examples that do not produce a consistent result (i.e. `AddNoiseToBinaryImage` due to `MersenneTwisterRandomVariateGenerator`)
- [ ] Rename baseline images to `OutputBaseline` for examples that consistently produce and save their output
- [ ] Implement `ImageFileWriter` for examples that do not save their output. Subsequently update the baseline comparison for that example, upload the image to `Girder` and finally update the `Documentation.rst`

コントリビューションガイド

このリポジトリのコントリビューションガイドは索引されていません

評価

この issue はまだ評価されていません。

新しい issue をメールで受け取る

初心者向けの GitHub issue を短くまとめたダイジェスト。