arduino / arduino/ArduinoCore-mbed

[AE-49] No video output for Portenta Vision Shield

Open
#661 1 comment 0 reactions 0 assignees View on GitHub
bug Camera Portenta Video windows
Dominant language
C
Stars
411
Forks
225
PR merge metrics
No merged PRs in 30d

Description

The data sent from [CameraCaptureRawBytes.ino](https://github.com/arduino/ArduinoCore-mbed/blob/main/libraries/Camera/examples/CameraCaptureRawBytes/CameraCaptureRawBytes.ino) sketch uploaded to a **Portenta H7 + Vision Shield board** is not displayed in the output in Processing 4.2 by the [CameraRawBytesVisualizer.pde](https://github.com/arduino/ArduinoCore-mbed/blob/main/libraries/Camera/extras/CameraRawBytesVisualizer/) sketch.

![image](https://user-images.githubusercontent.com/75624145/231061283-f6cdbd61-1207-4bfe-8a0c-cc1f50a82901.png)

Testing with the OpenMV IDE results in a smooth 60 FPS video feed, suggesting that the Portenta Vision shield in question is healthy.

![image](https://user-images.githubusercontent.com/75624145/231059889-c1f7d0d5-f111-47df-a580-e95679f8712d.png)

Compile

```
PS C:\Users\user\AppData\Local\Temp\.arduinoIDE-unsaved2023311-19888-xzbezf.tewf\CameraCaptureRawBytes> arduino-cli compile -b arduino:mbed_portenta:envie_m7

Used library Version Path
Camera 1.0 C:\Users\user\AppData\Local\Arduino15\packages\arduino\hardware\mbed_portenta\4.0.2\libraries\Camera
Wire C:\Users\user\AppData\Local\Arduino15\packages\arduino\hardware\mbed_portenta\4.0.2\libraries\Wire

Himax_HM0360 C:\Users\user\AppData\Local\Arduino15\packages\arduino\hardware\mbed_portenta\4.0.2\libraries\Himax_HM0360

Used platform Version Path
arduino:mbed_portenta 4.0.2 C:\Users\user\AppData\Local\Arduino15\packages\arduino\hardware\mbed_portenta\4.0.2

```

Upload

```
PS C:\Users\user\AppData\Local\Temp\.arduinoIDE-unsaved2023311-19888-xzbezf.tewf\CameraCaptureRawBytes> arduino-cli uploTOUCH: error during reset: opening port at 1200bps: Invalid serial port
dfu-util 0.10-dev

Copyright 2005-2009 Weston Schmidt, Harald Welte and OpenMoko Inc.
Copyright 2010-2021 Tormod Volden and Stefan Schmidt
This program is Free Software and has ABSOLUTELY NO WARRANTY
Please report bugs to http://sourceforge.net/p/dfu-util/tickets/

Warning: Invalid DFU suffix signature
A valid DFU suffix will be required in a future dfu-util release
Opening DFU capable USB device...
Device ID 2341:035b
Device DFU version 011a
Claiming USB DFU Interface...
Setting Alternate Interface #0 ...
Determining device status...
DFU state(2) = dfuIDLE, status(0) = No error condition is present
DFU mode device DFU version 011a
Device returned transfer size 4096
DfuSe interface name: "Internal Flash "
Downloading element to address = 0x08040000, size = 172204
Erase [=========================] 100% 172204 bytes
Erase done.
Download [=========================] 100% 172204 bytes
Download done.
File downloaded successfully
Transitioning to dfuMANIFEST state
```

Related to:
- https://github.com/arduino/ArduinoCore-mbed/issues/660

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with libraries/Camera/examples/CameraCaptureRawBytes/CameraCaptureRawBytes.ino and libraries/Camera/extras/CameraRawBytesVisualizer/CameraRawBytesVisualizer.pde, using the reported Portenta H7, Vision Shield, and Arduino mbed_portenta 4.0.2 setup. Reproduce the missing output in Processing 4.2, compare it with the working OpenMV IDE feed, and verify that the camera data is displayed when the issue is resolved.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp
Domain
computer-vision, embedded-iot
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.