PaddlePaddle / PaddlePaddle/FastDeploy

用FastDeploy完全按照官方流程转换ppyoloe_plus_crn_s_80e_coco.onnx成rknn,转成功后推理框不正确

Open
#1,951 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
3.7k
Forks
756
Avg merge
19h 28m
Merged PRs (30d)
4

Description

python3 infer.py --model_file ./ppyoloe_plus_crns_crn_s_80e_coco/ppyoloe_plus_crn_s_80e_coco_rk3588_quantized.rknn --config_file ./ppyoloe_plus_crn_s_80e_coco/infer_cfg.yml --image 000000014439.jpg

[INFO] fastdeploy/vision/common/processors/transform.cc(45)::FuseNormalizeCast Normalize and Cast are fused to Normalize in preprocessing pipeline.
[INFO] fastdeploy/vision/common/processors/transform.cc(93)::FuseNormalizeHWC2CHW Normalize and HWC2CHW are fused to NormalizeAndPermute in preprocessing pipeline.
[INFO] fastdeploy/vision/common/processors/transform.cc(159)::FuseNormalizeColorConvert BGR2RGB and NormalizeAndPermute are fused to NormalizeAndPermute with swap_rb=1
[INFO] fastdeploy/runtime/backends/rknpu2/rknpu2_backend.cc(81)::GetSDKAndDeviceVersion rknpu2 runtime version: 1.4.2b0 (c5d79ccf9@2023-02-14T17:55:39)
[INFO] fastdeploy/runtime/backends/rknpu2/rknpu2_backend.cc(82)::GetSDKAndDeviceVersion rknpu2 driver version: 0.8.2
index=0, name=image, n_dims=4, dims=[1, 640, 640, 3], n_elems=1228800, size=1228800, fmt=NHWC, type=INT8, qnt_type=AFFINE, zp=-128, scale=0.003922, pass_through=0
index=0, name=p2o.Mul.157, n_dims=4, dims=[1, 8400, 4, 1], n_elems=33600, size=33600, fmt=NCHW, type=FP32, qnt_type=AFFINE, zp=-72, scale=4.541211, pass_through=0
index=1, name=p2o.Concat.29, n_dims=4, dims=[1, 80, 8400, 1], n_elems=672000, size=672000, fmt=NCHW, type=FP32, qnt_type=AFFINE, zp=-128, scale=0.003515, pass_through=0
[INFO] fastdeploy/runtime/runtime.cc(341)::CreateRKNPU2Backend Runtime initialized with Backend::RKNPU2 in Device::RKNPU.
[WARNING] fastdeploy/runtime/backends/rknpu2/rknpu2_backend.cc(420)::InitRKNNTensorMemory The input tensor type != model's inputs type.The input_type need INT8,but inputs[0].type is UINT8
infer: 0.1364881992340088
DetectionResult: [xmin, ymin, xmax, ymax, score, label_id]
-22.706053,-8.599918, 404.167755, 260.864166, 0.868105, 0
-90.824211,-63.066059, 331.508392, 203.531387, 0.829444, 0
168.024796,-45.866226, 903.700928, 435.729187, 0.790784, 0
113.530266,65.932701, 113.530266, 68.799347, 0.776726, 0
172.566010,-28.666391, 594.898621, 232.197784, 0.748609, 0
386.002899,60.199425, 386.002899, 60.199425, 0.745094, 0
386.002899,65.932701, 386.002899, 68.799347, 0.734550, 0
390.544128,8.599918, 808.335510, 269.464081, 0.724007, 0
113.530266,71.665977, 113.530266, 71.665977, 0.695890, 0
336.049591,51.599506, 336.049591, 51.599506, 0.685346, 0
354.214417,65.932701, 354.214417, 68.799347, 0.685346, 0
372.379272,83.132538, 372.379272, 85.999176, 0.685346, 0
336.049591,57.332783, 336.049591, 57.332783, 0.678317, 0
386.002899,57.332783, 386.002899, 57.332783, 0.671288, 0
354.214417,71.665977, 354.214417, 71.665977, 0.657229, 0
336.049591,60.199425, 336.049591, 60.199425, 0.618569, 0
168.024796,57.332783, 172.566010, 57.332783, 0.611540, 0
326.967163,57.332783, 331.508392, 57.332783, 0.611540, 0
113.530266,60.199425, 113.530266, 60.199425, 0.611540, 0
372.379272,77.399261, 372.379272, 74.532623, 0.611540, 0
168.024796,51.599506, 172.566010, 51.599506, 0.600996, 0
372.379272,91.732452, 372.379272, 91.732452, 0.593967, 0
354.214417,60.199425, 354.214417, 60.199425, 0.572879, 0
326.967163,51.599506, 331.508392, 51.599506, 0.551791, 0
386.002899,51.599506, 386.002899, 51.599506, 0.544762, 0
326.967163,37.266312, 336.049591, 83.132538, 0.537733, 0
186.189636,45.866226, 199.813263, 60.199425, 0.516645, 0
195.272064,51.599506, 195.272064, 51.599506, 0.506102, 0
-122.612686,8.599918, 249.766586, 269.464081, 0.499072, 0
594.898621,149.065247, 594.898621, 149.065247, 0.499072, 0
195.272064,57.332783, 195.272064, 57.332783, 0.495558, 0
376.920471,83.132538, 372.379272, 85.999176, 0.495558, 0
358.755646,65.932701, 363.296844, 68.799347, 0.470956, 0
40.870895,131.865402, 40.870895, 131.865402, 0.470956, 0
113.530266,77.399261, 113.530266, 74.532623, 0.463927, 0
40.870895,126.132118, 40.870895, 126.132118, 0.463927, 0
186.189636,51.599506, 181.648422, 51.599506, 0.453383, 0
354.214417,77.399261, 354.214417, 74.532623, 0.453383, 0
458.662262,14.333196, 467.744690, 34.399673, 0.446354, 0
336.049591,65.932701, 336.049591, 68.799347, 0.446354, 0
594.898621,143.331955, 594.898621, 143.331955, 0.446354, 0
326.967163,60.199425, 331.508392, 60.199425, 0.442839, 0
358.755646,71.665977, 363.296844, 71.665977, 0.421751, 0
358.755646,60.199425, 363.296844, 60.199425, 0.404178, 0
277.013855,123.265488, 277.013855, 123.265488, 0.397149, 0
186.189636,57.332783, 181.648422, 57.332783, 0.383091, 0
49.953316,126.132118, 45.412106, 126.132118, 0.383091, 0
386.002899,45.866226, 386.002899, 48.732868, 0.376062, 0
122.612686,65.932701, 118.071480, 68.799347, 0.376062, 0
376.920471,80.265900, 372.379272, 83.132538, 0.376062, 0
376.920471,91.732452, 372.379272, 91.732452, 0.376062, 0
36.329685,131.865402, 36.329685, 131.865402, 0.376062, 0
36.329685,126.132118, 36.329685, 126.132118, 0.369032, 0
603.981018,143.331955, 599.439819, 143.331955, 0.369032, 0
326.967163,37.266312, 345.132019, 77.399261, 0.362003, 0
122.612686,71.665977, 118.071480, 71.665977, 0.362003, 0
177.107208,117.532211, 177.107208, 114.665565, 0.362003, 0
49.953316,131.865402, 45.412106, 131.865402, 0.362003, 0
40.870895,134.732040, 40.870895, 134.732040, 0.362003, 0
372.379272,100.332367, 372.379272, 97.465736, 0.354974, 0
386.002899,71.665977, 386.002899, 71.665977, 0.351460, 0
-213.436905,-111.798927, 544.945251, 366.929810, 0.340916, 0
376.920471,57.332783, 372.379272, 57.332783, 0.340916, 0
372.379272,71.665977, 372.379272, 71.665977, 0.333887, 0
277.013855,117.532211, 277.013855, 114.665565, 0.323343, 0
49.953316,134.732040, 45.412106, 134.732040, 0.323343, 0
603.981018,134.732040, 599.439819, 134.732040, 0.323343, 0
376.920471,60.199425, 372.379272, 60.199425, 0.316314, 0
594.898621,134.732040, 594.898621, 134.732040, 0.316314, 0
254.307800,88.865814, 672.099182, 352.596619, 0.302255, 0
72.659370,169.131714, 77.200584, 169.131714, 0.390120, 24
81.741791,169.131714, 81.741791, 169.131714, 0.390120, 24
63.576950,169.131714, 63.576950, 169.131714, 0.376062, 24
72.659370,160.531799, 77.200584, 160.531799, 0.362003, 24
63.576950,160.531799, 63.576950, 160.531799, 0.351460, 24
81.741791,160.531799, 81.741791, 160.531799, 0.351460, 24
63.576950,143.331955, 63.576950, 143.331955, 0.333887, 24
63.576950,149.065247, 63.576950, 149.065247, 0.333887, 24
13.623632,169.131714, 13.623632, 169.131714, 0.316314, 24
72.659370,149.065247, 77.200584, 149.065247, 0.309284, 24
72.659370,157.665161, 77.200584, 157.665161, 0.309284, 24
72.659370,143.331955, 77.200584, 143.331955, 0.302255, 24
-59.035740,-37.266312, 699.346436, 441.462433, 0.685346, 33
90.824211,131.865402, 90.824211, 131.865402, 0.572879, 56
-99.906631,8.599918, 322.425964, 269.464081, 0.541248, 56
90.824211,134.732040, 90.824211, 134.732040, 0.516645, 56
95.365425,134.732040, 95.365425, 134.732040, 0.506102, 56
95.365425,131.865402, 95.365425, 131.865402, 0.495558, 56
81.741791,131.865402, 81.741791, 131.865402, 0.411208, 56
104.447845,143.331955, 108.989059, 143.331955, 0.397149, 56
104.447845,134.732040, 108.989059, 134.732040, 0.362003, 56
104.447845,149.065247, 108.989059, 149.065247, 0.362003, 56
81.741791,134.732040, 81.741791, 134.732040, 0.351460, 56
113.530266,134.732040, 113.530266, 134.732040, 0.340916, 56
90.824211,143.331955, 90.824211, 143.331955, 0.333887, 56
113.530266,143.331955, 113.530266, 143.331955, 0.323343, 56
95.365425,143.331955, 95.365425, 143.331955, 0.316314, 56
113.530266,149.065247, 113.530266, 149.065247, 0.316314, 56

Visualized result save in ./visualized_result.jpg

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with infer.py and the ppyoloe_plus_crn_s_80e_coco/infer_cfg.yml configuration, then reproduce the command using the referenced RKNN model and 000000014439.jpg. Inspect the visualized_result.jpg output and the logged INT8/UINT8 input-type warning; done means the converted model produces correct detection boxes.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
ai, backend
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.