NVIDIA-ISAAC-ROS / NVIDIA-ISAAC-ROS/isaac_ros_compression

Encoder GFX errors

Open
#11 4 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
C
Stars
73
Forks
16
PR merge metrics
No merged PRs in 30d

Description

I am trying to run the encoder to compress my video stream. The v4l2_camera node outputs the video stream in RGB8 format with a resolution of 1920x1080 pixels. This is the complete log when running the encoder:

nvidia@tegra-ubuntu:~/Projects/autonomy$ ros2 launch isaac_ros_h264_encoder isaac_ros_h264_encoder.launch.py
[INFO] [launch]: All log files can be found below /home/nvidia/.ros/log/2024-05-16-13-59-46-379247-tegra-ubuntu-2933
[INFO] [launch]: Default logging verbosity is set to INFO
[INFO] [component_container-1]: process started with pid [2946]
[component_container-1] [INFO] [1715867987.012505907] [encoder_container]: Load Library: /opt/ros/humble/lib/libencoder_node.so
[component_container-1] [INFO] [1715867987.055813639] [encoder_container]: Found class: rclcpp_components::NodeFactoryTemplate<nvidia::isaac_ros::h264_encoder::EncoderNode>
[component_container-1] [INFO] [1715867987.055943371] [encoder_container]: Instantiate class: rclcpp_components::NodeFactoryTemplate<nvidia::isaac_ros::h264_encoder::EncoderNode>
[component_container-1] [INFO] [1715867987.064485368] [NitrosContext]: [NitrosContext] Creating a new shared context
[component_container-1] [INFO] [1715867987.064770945] [encoder]: [NitrosNode] Initializing NitrosNode
[component_container-1] [INFO] [1715867987.065782273] [NitrosContext]: [NitrosContext] Loading extension: gxf/lib/std/libgxf_std.so
[component_container-1] [INFO] [1715867987.075685465] [NitrosContext]: [NitrosContext] Loading extension: gxf/lib/libgxf_gxf_helpers.so
[component_container-1] [INFO] [1715867987.080819034] [NitrosContext]: [NitrosContext] Loading extension: gxf/lib/libgxf_sight.so
[component_container-1] [INFO] [1715867987.087217412] [NitrosContext]: [NitrosContext] Loading extension: gxf/lib/libgxf_atlas.so
[component_container-1] [INFO] [1715867987.093736369] [NitrosContext]: [NitrosContext] Loading application: '/opt/ros/humble/share/isaac_ros_nitros/config/type_adapter_nitros_context_graph.yaml'
[component_container-1] [INFO] [1715867987.095303906] [NitrosContext]: [NitrosContext] Initializing application...
[component_container-1] [INFO] [1715867987.100450149] [NitrosContext]: [NitrosContext] Running application...
[component_container-1] 2024-05-16 13:59:47.100 WARN  gxf/std/program.cpp@514: No system specified. Nothing to do
[component_container-1] [INFO] [1715867987.102732588] [encoder]: [NitrosNode] Starting NitrosNode
[component_container-1] [INFO] [1715867987.102811727] [encoder]: [NitrosNode] Loading built-in preset extension specs
[component_container-1] [INFO] [1715867987.106863438] [encoder]: [NitrosNode] Loading built-in extension specs
[component_container-1] [INFO] [1715867987.106983922] [encoder]: [NitrosNode] Loading preset extension specs
[component_container-1] [INFO] [1715867987.108195640] [encoder]: [NitrosNode] Loading extension specs
[component_container-1] [INFO] [1715867987.108257914] [encoder]: [NitrosNode] Loading generator rules
[component_container-1] [INFO] [1715867987.108761962] [encoder]: [NitrosNode] Loading extensions
[component_container-1] [INFO] [1715867987.109186488] [encoder]: [NitrosContext] Loading extension: gxf/lib/libgxf_message_compositor.so
[component_container-1] [INFO] [1715867987.111568163] [encoder]: [NitrosContext] Loading extension: gxf/lib/multimedia/libgxf_multimedia.so
[component_container-1] [INFO] [1715867987.113300633] [encoder]: [NitrosContext] Loading extension: gxf/lib/cuda/libgxf_cuda.so
[component_container-1] [INFO] [1715867987.115114066] [encoder]: [NitrosContext] Loading extension: gxf/lib/serialization/libgxf_serialization.so
[component_container-1] [INFO] [1715867987.120924329] [encoder]: [NitrosContext] Loading extension: gxf/lib/image_proc/libgxf_tensorops.so
[component_container-1] [INFO] [1715867987.129957222] [encoder]: [NitrosContext] Loading extension: gxf/lib/codec/libgxf_video_encoder_extension.so
[component_container-1] [INFO] [1715867987.133767422] [encoder]: [NitrosNode] Loading graph to the optimizer
[component_container-1] [INFO] [1715867987.137779676] [encoder]: [NitrosNode] Running optimization
[component_container-1] [INFO] [1715867987.154133471] [encoder]: [NitrosNode] Obtaining graph IO group info from the optimizer
[component_container-1] [INFO] [1715867987.155573836] [encoder]: [NitrosNode] Creating negotiated publishers/subscribers
[component_container-1] [INFO] [1715867987.164457188] [encoder]: [NitrosNode] Starting negotiation...
[INFO] [launch_ros.actions.load_composable_nodes]: Loaded node '/encoder' in container '/encoder_container'
[component_container-1] [INFO] [1715867987.265878142] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.273569424] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.278022268] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.282964216] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.287133051] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.300516161] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.314412982] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.321416435] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.327821437] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.353363617] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.361255322] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.369017742] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.378941287] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.393599828] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.410459367] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.426806474] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.443531993] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.459325642] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.477366466] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.503145966] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.520248872] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.532304132] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.553277177] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.563497402] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.589027774] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.603186524] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.624449658] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.634597753] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.652878521] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.669885713] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.686772869] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.694535961] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.719176065] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.737544451] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.753365750] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.770023906] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.788592107] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.823769439] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.828526709] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.857608072] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.869316761] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.874262837] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.900512976] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.906230532] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.941997706] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.949193197] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.955347662] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.968773077] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.977755536] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.993826698] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867988.010489367] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867988.028241638] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867988.043269663] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867988.059706437] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867988.077097512] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867988.093798710] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867988.110184218] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867988.125980940] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867988.143423953] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867988.159436809] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867988.165345827] [encoder]: [NitrosNode] Starting post negotiation setup
[component_container-1] [INFO] [1715867988.165511465] [encoder]: [NitrosNode] Getting data format negotiation results
[component_container-1] [INFO] [1715867988.165550762] [encoder]: [NitrosSubscriber] Negotiation ended with no results
[component_container-1] [INFO] [1715867988.165571947] [encoder]: [NitrosSubscriber] Use the compatible subscriber: topic_name="/image_raw", data_format="nitros_image_bgr8"
[component_container-1] [INFO] [1715867988.165676270] [encoder]: [NitrosPublisher] Negotiation ended with no results
[component_container-1] [INFO] [1715867988.165699855] [encoder]: [NitrosPublisher] Use only the compatible publisher: topic_name="/image_compressed", data_format="nitros_compressed_image"
[component_container-1] [INFO] [1715867988.168834641] [encoder]: [NitrosNode] Exporting the final graph based on the negotiation results
[component_container-1] [INFO] [1715867988.177364830] [encoder]: [NitrosNode] Wrote the final top level YAML graph to "/tmp/isaac_ros_nitros/graphs/OXBWGRJEFH/OXBWGRJEFH.yaml"
[component_container-1] [INFO] [1715867988.177526019] [encoder]: [NitrosNode] Calling user's pre-load-graph callback
[component_container-1] [INFO] [1715867988.177580997] [encoder]: [EncoderNode] preLoadGraphCallback().
[component_container-1] [INFO] [1715867988.177600741] [encoder]: [NitrosNode] Loading application
[component_container-1] [INFO] [1715867988.177653543] [encoder]: [NitrosContext] Loading application: '/tmp/isaac_ros_nitros/graphs/OXBWGRJEFH/OXBWGRJEFH.yaml'
[component_container-1] [INFO] [1715867988.181164502] [encoder]: [NitrosNode] Linking Nitros pub/sub to the loaded application
[component_container-1] [INFO] [1715867988.181431966] [encoder]: [NitrosNode] Calling user's post-load-graph callback
[component_container-1] [INFO] [1715867988.181463167] [encoder]: [EncoderNode] postLoadGraphCallback().
[component_container-1] [INFO] [1715867988.181557634] [encoder]: [NitrosContext] Initializing application...
[component_container-1] 2024-05-16 13:59:48.540 ERROR /data/jenkins/ros/workspace/ly_debian-compatible-release-2.1/isaac_ros-dev/ros_ws/src/isaac_ros_compression/isaac_ros_h264_encoder/gxf/codec/video_encoder/videoencoder_context.cpp@147: Failed to open device:v4l2_open() failed
[component_container-1] 2024-05-16 13:59:48.540 ERROR /data/jenkins/ros/workspace/ly_debian-compatible-release-2.1/isaac_ros-dev/ros_ws/src/isaac_ros_compression/isaac_ros_h264_encoder/gxf/codec/video_encoder/videoencoder_context.cpp@79: Failed to create default encoder context
[component_container-1] 2024-05-16 13:59:48.540 ERROR gxf/std/entity_warden.cpp@406: Failed to initialize component 00268 (encoder_context)
[component_container-1] 2024-05-16 13:59:48.540 ERROR gxf/core/runtime.cpp@685: Could not initialize entity 'OXBWGRJEFH_global' (E265): GXF_FAILURE
[component_container-1] 2024-05-16 13:59:48.540 ERROR gxf/std/program.cpp@236: Failed to activate entity 00265 named OXBWGRJEFH_global: GXF_FAILURE
[component_container-1] 2024-05-16 13:59:48.540 ERROR gxf/std/program.cpp@238: Deactivating...
[component_container-1] 2024-05-16 13:59:48.551 ERROR gxf/core/runtime.cpp@1384: Graph activation failed with error: GXF_FAILURE
[component_container-1] [ERROR] [1715867988.551915345] [encoder]: [NitrosContext] GxfGraphActivate Error: GXF_FAILURE
[component_container-1] [ERROR] [1715867988.552110679] [encoder]: [NitrosNode] runGraphAsync Error: GXF_FAILURE
[component_container-1] terminate called after throwing an instance of 'std::runtime_error'
[component_container-1]   what():  [NitrosNode] runGraphAsync Error: GXF_FAILURE
[ERROR] [component_container-1]: process has died [pid 2946, exit code -6, cmd '/opt/ros/humble/lib/rclcpp_components/component_container --ros-args --log-level info --ros-args -r __node:=encoder_container -r __ns:=/'].
nvidia@tegra-ubuntu:~/Projects/

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the isaac_ros_h264_encoder.launch.py entry point and the supplied encoder log, focusing on the v4l2_camera RGB8 1920x1080 input and the repeated receiver-pointer warnings. Determine why this stream is not processed and verify that the encoder runs without those errors.

Written by the indexing model from the issue text.

Assessment

Tech stack
c, linux
Domain
audio-video-rtc, embedded-iot
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.