Issues in Querying LLM and Augmenting Holograms

Hi,

I followed the instructions and successfully deployed the application on my HoloLens 2, connecting it to my servers on the PC.

Then, the Sigma voice assistant popped up. However, no matter what I asked, it only responded with, "Sorry, I don't understand that."

Here is my environment variable setup:

This is my sigma server setup:

This is my client app setup:

I also uploaded the key to the Hololens 2 Document folder:

I also want to explore how to augment holograms onto real-world objects, as shown in your paper. However, I couldn’t find any code or instructions implementing this.

I really appreciate any help or guidance from you.

Thanks,
Yicheng

Start by reviewing the Sigma server setup, client app setup, environment variables, and HoloLens 2 Document folder contents described in the report. Reproduce the assistant response on HoloLens 2 and trace the server-client connection; the issue is not complete until the cause of the repeated fallback response and the missing hologram-augmentation guidance or implementation are defined.