Where is the Visual Wake Word test set?

I would like to evaluate the pretrained MobileNet model on the preprocessed COCO2014 test set, but I am not able to find this preprcessed test set anywhere in the repo. Where can I find it? For the other three datasets (AD, IC, KS) it has been already provided in the repo.

I suspect I have to generate it by myself using this script setting dataType='test2014', because this should be the same script that has been used to create the training+validation dataset that is used for the training and that can be downloaded here.

Moreover, the paper entitled "MLPerf Tiny Benchmark" mentions the presence of this test set for the VWW problem at paragraph 4.1.

Finally, why is there no test.py (or evaluated.py) script to run the model on the test set, while for all the other three datasets (AD, IC, KS) there are such scripts?

Thank you,
Regards,
Luca Urbinati

Start with benchmark/training/visual_wake_words/convert_vww.py and download_and_train_vww.sh, then inspect the linked buildPersonDetectionDatabase.py script and the existing test or evaluation scripts for AD, IC, and KS. Determine whether the preprocessed COCO2014 test set is present or reproducible, and whether VWW needs a corresponding evaluation entry point; done means documenting the test-set location or generation path and providing the missing evaluation support.