arduino / arduino/ArduinoCore-mbed

[AE-49] Chopped up video output from the Nicla Vision

Open
#660 1 comment 0 reactions 0 assignees View on GitHub
bug Camera nicla Video windows
Dominant language
C
Stars
411
Forks
225
PR merge metrics
No merged PRs in 30d

Description

The data sent from [CameraCaptureRawBytes.ino](https://github.com/arduino/ArduinoCore-mbed/blob/main/libraries/Camera/examples/CameraCaptureRawBytes/CameraCaptureRawBytes.ino) sketch uploaded to a Nicla Vision board is displayed as chopped up output in Processing 4.2 by the [CameraRawBytesVisualizer.pde](https://github.com/arduino/ArduinoCore-mbed/blob/main/libraries/Camera/extras/CameraRawBytesVisualizer/) sketch.

![image](https://user-images.githubusercontent.com/75624145/231053863-1bce6dc1-1e7a-40eb-9201-9404ac41b45e.png)

Testing with the OpenMV IDE results in a smooth 20 FPS video feed, suggesting that the Nicla Vision board in question is healthy.

![image](https://user-images.githubusercontent.com/75624145/231053876-bea6eaa6-f97d-47a0-a927-ed8e28b2d004.png)

Compile

```
PS C:\Users\user\AppData\Local\Temp\.arduinoIDE-unsaved2023311-38456-1j6f6yl.zru7\CameraCaptureRawBytes> arduino-cli compile -b arduino:mbed_nicla:nicla_vision
Sketch uses 134312 bytes (6%) of program storage space. Maximum is 1966080 bytes.
Global variables use 54464 bytes (10%) of dynamic memory, leaving 469160 bytes for local variables. Maximum is 523624 bytes.

Used library Version Path
Camera 1.0 C:\Users\user\AppData\Local\Arduino15\packages\arduino\hardware\mbed_nicla\4.0.2\libraries\Camera
GC2145 C:\Users\user\AppData\Local\Arduino15\packages\arduino\hardware\mbed_nicla\4.0.2\libraries\GC2145
Used platform Version Path
arduino:mbed_nicla 4.0.2 C:\Users\user\AppData\Local\Arduino15\packages\arduino\hardware\mbed_nicla\4.0.2

```

Upload

```
PS C:\Users\user\AppData\Local\Temp\.arduinoIDE-unsaved2023311-38456-1j6f6yl.zru7\CameraCaptureRawBytes> arduino-cli upload -p COM35 --fqbn arduino:mbed_nicla:nicla_vision
TOUCH: error during reset: opening port at 1200bps: Invalid serial port
dfu-util 0.10-dev

Copyright 2005-2009 Weston Schmidt, Harald Welte and OpenMoko Inc.
Copyright 2010-2021 Tormod Volden and Stefan Schmidt
This program is Free Software and has ABSOLUTELY NO WARRANTY
Please report bugs to http://sourceforge.net/p/dfu-util/tickets/

Warning: Invalid DFU suffix signature
A valid DFU suffix will be required in a future dfu-util release
Opening DFU capable USB device...
Device ID 2341:035f
Device DFU version 011a
Claiming USB DFU Interface...
Setting Alternate Interface #0 ...
Determining device status...
DFU state(2) = dfuIDLE, status(0) = No error condition is present
DFU mode device DFU version 011a
Device returned transfer size 4096
DfuSe interface name: "Internal Flash "
Downloading element to address = 0x08040000, size = 136668
Erase [=========================] 100% 136668 bytes
Erase done.
Download [=========================] 100% 136668 bytes
Download done.
File downloaded successfully
Transitioning to dfuMANIFEST state
```

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with libraries/Camera/examples/CameraCaptureRawBytes/CameraCaptureRawBytes.ino and libraries/Camera/extras/CameraRawBytesVisualizer/CameraRawBytesVisualizer.pde. Reproduce the Nicla Vision feed and compare the raw-byte framing with what the Processing visualizer expects; done means the output is displayed as a smooth video feed rather than chopped-up frames.

Written by the indexing model from the issue text.

Assessment

Tech stack
c
Domain
embedded-iot
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.