PaddlePaddle / PaddlePaddle/FastDeploy
用FastDeploy完全按照官方流程转换ppyoloe_plus_crn_s_80e_coco.onnx成rknn,转成功后推理框不正确
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 3.7k
- Forks
- 756
- Avg merge
- 19h 28m
- Merged PRs (30d)
- 4
Description
python3 infer.py --model_file ./ppyoloe_plus_crns_crn_s_80e_coco/ppyoloe_plus_crn_s_80e_coco_rk3588_quantized.rknn --config_file ./ppyoloe_plus_crn_s_80e_coco/infer_cfg.yml --image 000000014439.jpg
[INFO] fastdeploy/vision/common/processors/transform.cc(45)::FuseNormalizeCast Normalize and Cast are fused to Normalize in preprocessing pipeline.
[INFO] fastdeploy/vision/common/processors/transform.cc(93)::FuseNormalizeHWC2CHW Normalize and HWC2CHW are fused to NormalizeAndPermute in preprocessing pipeline.
[INFO] fastdeploy/vision/common/processors/transform.cc(159)::FuseNormalizeColorConvert BGR2RGB and NormalizeAndPermute are fused to NormalizeAndPermute with swap_rb=1
[INFO] fastdeploy/runtime/backends/rknpu2/rknpu2_backend.cc(81)::GetSDKAndDeviceVersion rknpu2 runtime version: 1.4.2b0 (c5d79ccf9@2023-02-14T17:55:39)
[INFO] fastdeploy/runtime/backends/rknpu2/rknpu2_backend.cc(82)::GetSDKAndDeviceVersion rknpu2 driver version: 0.8.2
index=0, name=image, n_dims=4, dims=[1, 640, 640, 3], n_elems=1228800, size=1228800, fmt=NHWC, type=INT8, qnt_type=AFFINE, zp=-128, scale=0.003922, pass_through=0
index=0, name=p2o.Mul.157, n_dims=4, dims=[1, 8400, 4, 1], n_elems=33600, size=33600, fmt=NCHW, type=FP32, qnt_type=AFFINE, zp=-72, scale=4.541211, pass_through=0
index=1, name=p2o.Concat.29, n_dims=4, dims=[1, 80, 8400, 1], n_elems=672000, size=672000, fmt=NCHW, type=FP32, qnt_type=AFFINE, zp=-128, scale=0.003515, pass_through=0
[INFO] fastdeploy/runtime/runtime.cc(341)::CreateRKNPU2Backend Runtime initialized with Backend::RKNPU2 in Device::RKNPU.
[WARNING] fastdeploy/runtime/backends/rknpu2/rknpu2_backend.cc(420)::InitRKNNTensorMemory The input tensor type != model's inputs type.The input_type need INT8,but inputs[0].type is UINT8
infer: 0.1364881992340088
DetectionResult: [xmin, ymin, xmax, ymax, score, label_id]
-22.706053,-8.599918, 404.167755, 260.864166, 0.868105, 0
-90.824211,-63.066059, 331.508392, 203.531387, 0.829444, 0
168.024796,-45.866226, 903.700928, 435.729187, 0.790784, 0
113.530266,65.932701, 113.530266, 68.799347, 0.776726, 0
172.566010,-28.666391, 594.898621, 232.197784, 0.748609, 0
386.002899,60.199425, 386.002899, 60.199425, 0.745094, 0
386.002899,65.932701, 386.002899, 68.799347, 0.734550, 0
390.544128,8.599918, 808.335510, 269.464081, 0.724007, 0
113.530266,71.665977, 113.530266, 71.665977, 0.695890, 0
336.049591,51.599506, 336.049591, 51.599506, 0.685346, 0
354.214417,65.932701, 354.214417, 68.799347, 0.685346, 0
372.379272,83.132538, 372.379272, 85.999176, 0.685346, 0
336.049591,57.332783, 336.049591, 57.332783, 0.678317, 0
386.002899,57.332783, 386.002899, 57.332783, 0.671288, 0
354.214417,71.665977, 354.214417, 71.665977, 0.657229, 0
336.049591,60.199425, 336.049591, 60.199425, 0.618569, 0
168.024796,57.332783, 172.566010, 57.332783, 0.611540, 0
326.967163,57.332783, 331.508392, 57.332783, 0.611540, 0
113.530266,60.199425, 113.530266, 60.199425, 0.611540, 0
372.379272,77.399261, 372.379272, 74.532623, 0.611540, 0
168.024796,51.599506, 172.566010, 51.599506, 0.600996, 0
372.379272,91.732452, 372.379272, 91.732452, 0.593967, 0
354.214417,60.199425, 354.214417, 60.199425, 0.572879, 0
326.967163,51.599506, 331.508392, 51.599506, 0.551791, 0
386.002899,51.599506, 386.002899, 51.599506, 0.544762, 0
326.967163,37.266312, 336.049591, 83.132538, 0.537733, 0
186.189636,45.866226, 199.813263, 60.199425, 0.516645, 0
195.272064,51.599506, 195.272064, 51.599506, 0.506102, 0
-122.612686,8.599918, 249.766586, 269.464081, 0.499072, 0
594.898621,149.065247, 594.898621, 149.065247, 0.499072, 0
195.272064,57.332783, 195.272064, 57.332783, 0.495558, 0
376.920471,83.132538, 372.379272, 85.999176, 0.495558, 0
358.755646,65.932701, 363.296844, 68.799347, 0.470956, 0
40.870895,131.865402, 40.870895, 131.865402, 0.470956, 0
113.530266,77.399261, 113.530266, 74.532623, 0.463927, 0
40.870895,126.132118, 40.870895, 126.132118, 0.463927, 0
186.189636,51.599506, 181.648422, 51.599506, 0.453383, 0
354.214417,77.399261, 354.214417, 74.532623, 0.453383, 0
458.662262,14.333196, 467.744690, 34.399673, 0.446354, 0
336.049591,65.932701, 336.049591, 68.799347, 0.446354, 0
594.898621,143.331955, 594.898621, 143.331955, 0.446354, 0
326.967163,60.199425, 331.508392, 60.199425, 0.442839, 0
358.755646,71.665977, 363.296844, 71.665977, 0.421751, 0
358.755646,60.199425, 363.296844, 60.199425, 0.404178, 0
277.013855,123.265488, 277.013855, 123.265488, 0.397149, 0
186.189636,57.332783, 181.648422, 57.332783, 0.383091, 0
49.953316,126.132118, 45.412106, 126.132118, 0.383091, 0
386.002899,45.866226, 386.002899, 48.732868, 0.376062, 0
122.612686,65.932701, 118.071480, 68.799347, 0.376062, 0
376.920471,80.265900, 372.379272, 83.132538, 0.376062, 0
376.920471,91.732452, 372.379272, 91.732452, 0.376062, 0
36.329685,131.865402, 36.329685, 131.865402, 0.376062, 0
36.329685,126.132118, 36.329685, 126.132118, 0.369032, 0
603.981018,143.331955, 599.439819, 143.331955, 0.369032, 0
326.967163,37.266312, 345.132019, 77.399261, 0.362003, 0
122.612686,71.665977, 118.071480, 71.665977, 0.362003, 0
177.107208,117.532211, 177.107208, 114.665565, 0.362003, 0
49.953316,131.865402, 45.412106, 131.865402, 0.362003, 0
40.870895,134.732040, 40.870895, 134.732040, 0.362003, 0
372.379272,100.332367, 372.379272, 97.465736, 0.354974, 0
386.002899,71.665977, 386.002899, 71.665977, 0.351460, 0
-213.436905,-111.798927, 544.945251, 366.929810, 0.340916, 0
376.920471,57.332783, 372.379272, 57.332783, 0.340916, 0
372.379272,71.665977, 372.379272, 71.665977, 0.333887, 0
277.013855,117.532211, 277.013855, 114.665565, 0.323343, 0
49.953316,134.732040, 45.412106, 134.732040, 0.323343, 0
603.981018,134.732040, 599.439819, 134.732040, 0.323343, 0
376.920471,60.199425, 372.379272, 60.199425, 0.316314, 0
594.898621,134.732040, 594.898621, 134.732040, 0.316314, 0
254.307800,88.865814, 672.099182, 352.596619, 0.302255, 0
72.659370,169.131714, 77.200584, 169.131714, 0.390120, 24
81.741791,169.131714, 81.741791, 169.131714, 0.390120, 24
63.576950,169.131714, 63.576950, 169.131714, 0.376062, 24
72.659370,160.531799, 77.200584, 160.531799, 0.362003, 24
63.576950,160.531799, 63.576950, 160.531799, 0.351460, 24
81.741791,160.531799, 81.741791, 160.531799, 0.351460, 24
63.576950,143.331955, 63.576950, 143.331955, 0.333887, 24
63.576950,149.065247, 63.576950, 149.065247, 0.333887, 24
13.623632,169.131714, 13.623632, 169.131714, 0.316314, 24
72.659370,149.065247, 77.200584, 149.065247, 0.309284, 24
72.659370,157.665161, 77.200584, 157.665161, 0.309284, 24
72.659370,143.331955, 77.200584, 143.331955, 0.302255, 24
-59.035740,-37.266312, 699.346436, 441.462433, 0.685346, 33
90.824211,131.865402, 90.824211, 131.865402, 0.572879, 56
-99.906631,8.599918, 322.425964, 269.464081, 0.541248, 56
90.824211,134.732040, 90.824211, 134.732040, 0.516645, 56
95.365425,134.732040, 95.365425, 134.732040, 0.506102, 56
95.365425,131.865402, 95.365425, 131.865402, 0.495558, 56
81.741791,131.865402, 81.741791, 131.865402, 0.411208, 56
104.447845,143.331955, 108.989059, 143.331955, 0.397149, 56
104.447845,134.732040, 108.989059, 134.732040, 0.362003, 56
104.447845,149.065247, 108.989059, 149.065247, 0.362003, 56
81.741791,134.732040, 81.741791, 134.732040, 0.351460, 56
113.530266,134.732040, 113.530266, 134.732040, 0.340916, 56
90.824211,143.331955, 90.824211, 143.331955, 0.333887, 56
113.530266,143.331955, 113.530266, 143.331955, 0.323343, 56
95.365425,143.331955, 95.365425, 143.331955, 0.316314, 56
113.530266,149.065247, 113.530266, 149.065247, 0.316314, 56
Visualized result save in ./visualized_result.jpg
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with infer.py and the ppyoloe_plus_crn_s_80e_coco/infer_cfg.yml configuration, then reproduce the command using the referenced RKNN model and 000000014439.jpg. Inspect the visualized_result.jpg output and the logged INT8/UINT8 input-type warning; done means the converted model produces correct detection boxes.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- ai, backend
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100