NVIDIA / NVIDIA/IsaacTeleop

Apple Vision Pro rendering issue

Open
#364 2 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
385
Forks
88
Avg merge
3d 23h
Merged PRs (30d)
82

Description

Hi, has anyone run into issues of AVP not showing a scene from Isaac Lab properly and displaying highly pixellated noise instead? Moslty green dots but sometimes green and pink lines or small color blocks.

The AVP client is Isaac XR Teleop sample client (any version) and Isaac Sim 5.1.0, Isaac Lab 2.3.2 and bundled CloudXR 5.0.1. Identical issue is happening on AVP with Vision OS 2.11 and 26.4. Hands tracking seems to work fine. NV_DEVICE_PROFILE is set to auto-native. NV_GPU_INDEX was set to 0, 1, 2 and 3 in separate tests giving identical results. GPUs are 4x RTX 6000 Ada (non Pro). Isaac XR Teleop Sample Client 2.3.0, 2.2.0 and 1.0.0.

Is there some CODEC mismatch or some setting that needs tweaking on either side?

Image Image

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reproducing the rendering problem with the listed Isaac XR Teleop, Isaac Sim, Isaac Lab, CloudXR, visionOS, and GPU versions, then compare the AVP client and server codec or device settings. Done means identifying a confirmed compatibility issue or setting that resolves the pixelated output, or documenting the evidence needed for escalation.

Written by the indexing model from the issue text.

Assessment

Domain
computer-graphics, networking
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.