different benchmark result
Nobody has claimed this yet.
- Dominant language
- C++
- Stars
- 23.8k
- Forks
- 4.5k
- Avg merge
- 2d 20h
- Merged PRs (30d)
- 37
Description
I have two models, both of them are exactly the same.
when I executed benchmark of NCNN of darknet2ncnn(exists on darknet2ncnn/ncnn/build/benchmark/) on Raspberry pi 3b, I got 150ms however with latest version of original NCNN's repository(https://github.com/Tencent/ncnn) I got 350ms.
I got hesitated. what is the problem and which one is really true?
I've built NCNN from original repository with following command :
cmake -DCMAKE_BUILD_TYPE=Release -DNCNN_VULKAN=OFF -DNCNN_SYSTEM_GLSLANG=ON -DNCNN_BUILD_EXAMPLES=ON -DCMAKE_TOOLCHAIN_FILE=../toolchains/pi3.toolchain.cmake -DPI3=ON ..
and built NCNN of darknet2ncnn with:
cmake ..
the NCNN's version of darknet2ncnn is the 2020-03-06.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the benchmark under darknet2ncnn/ncnn/build/benchmark and compare the two builds made with the provided CMake commands, including the pi3.toolchain.cmake and PI3 settings. Reproduce both measurements on the Raspberry Pi 3B and document which build or configuration accounts for the 150ms versus 350ms result.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cmake, cpp, raspberry-pi
- Domain
- embedded-iot, performance
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100