ROSbot XL demo process given prompts. Help.

As a group we are trying to run RAI in order to accomplish our project. As for testing and initialize our project we decided to launch the demo of launch ROSbot XL demo. We can completely launch the game engine and GUI and allow us control to robot by prompts without any errors. But for some reason our robot rejects EVERY prompt that we entered and it is impossible to move our robot by prompts. I will send the logs. May anybody help?

libgomp: Invalid value for environment variable OMP_WAIT_POLICY
2026-01-21 13:15:38 c91fe47d0149 matplotlib.font_manager[29258] INFO Failed to extract font properties from /usr/share/fonts/truetype/noto/NotoColorEmoji.ttf: Can not load face (unknown file format; error code 0x2)
2026-01-21 13:15:38 c91fe47d0149 matplotlib.font_manager[29258] INFO generated new fontManager

libgomp: Invalid value for environment variable OMP_WAIT_POLICY
2026-01-21 13:15:48 c91fe47d0149 rai.initialization.model_initialization[29258] INFO Initializing complex_model: Vendor: ollama, Model: llama3.2
2026-01-21 13:16:56 c91fe47d0149 ROS2Connector[29258] WARNING MultiThreadedExecutor is 66.43 seconds behind. If you see this message frequently, consider switching to SingleThreadedExecutor.
2026-01-21 13:17:21 c91fe47d0149 httpx[29258] INFO HTTP Request: POST http://10.10.100.61:11434/api/chat "HTTP/1.1 200 OK"
2026-01-21 13:17:21 c91fe47d0149 rai.agents.langchain.core.tool_runner[29258] INFO Running tool: navigate_to_pose, args: {'x': -0.2175, 'y': -0.8775, 'yaw': None, 'z': None}
2026-01-21 13:17:21 c91fe47d0149 rai.agents.langchain.core.tool_runner[29258] INFO 
                                    Validation error in tool navigate_to_pose:
                                    NavigateToPoseToolInput
                                    Number of errors: 2
                                    Errors:
                                    [
  {
    "type": "float_type",
    "loc": [
      "z"
    ],
    "msg": "Input should be a valid number",
    "input": null
  },
  {
    "type": "float_type",
    "loc": [
      "yaw"
    ],
    "msg": "Input should be a valid number",
    "input": null
  }
]
                                
2026-01-21 13:17:21 c91fe47d0149 httpx[29258] INFO HTTP Request: POST http://10.10.100.61:11434/api/chat "HTTP/1.1 200 OK"
2026-01-21 13:41:07 c91fe47d0149 httpx[29258] INFO HTTP Request: POST http://10.10.100.61:11434/api/chat "HTTP/1.1 200 OK"
2026-01-21 13:41:07 c91fe47d0149 rai.agents.langchain.core.tool_runner[29258] INFO Running tool: navigate_to_pose, args: {'x': '-0.82', 'y': '3.525', 'yaw': None, 'z': None}
2026-01-21 13:41:07 c91fe47d0149 rai.agents.langchain.core.tool_runner[29258] INFO 
                                    Validation error in tool navigate_to_pose:
                                    NavigateToPoseToolInput
                                    Number of errors: 2
                                    Errors:
                                    [
  {
    "type": "float_type",
    "loc": [
      "z"
    ],
    "msg": "Input should be a valid number",
    "input": null
  },
  {
    "type": "float_type",
    "loc": [
      "yaw"
    ],
    "msg": "Input should be a valid number",
    "input": null
  }
]
                                
2026-01-21 13:41:07 c91fe47d0149 httpx[29258] INFO HTTP Request: POST http://10.10.100.61:11434/api/chat "HTTP/1.1 200 OK"
2026-01-21 13:41:21 c91fe47d0149 httpx[29258] INFO HTTP Request: POST http://10.10.100.61:11434/api/chat "HTTP/1.1 200 OK"
2026-01-21 13:41:21 c91fe47d0149 httpx[29258] INFO HTTP Request: POST http://10.10.100.61:11434/api/chat "HTTP/1.1 200 OK"
2026-01-21 13:42:12 c91fe47d0149 httpx[29258] INFO HTTP Request: POST http://10.10.100.61:11434/api/chat "HTTP/1.1 200 OK"
2026-01-21 13:42:12 c91fe47d0149 rai.agents.langchain.core.tool_runner[29258] INFO Running tool: navigate_to_pose, args: {'x': '0', 'y': '0', 'yaw': None, 'z': '0'}
2026-01-21 13:42:12 c91fe47d0149 rai.agents.langchain.core.tool_runner[29258] INFO 
                                    Validation error in tool navigate_to_pose:
                                    NavigateToPoseToolInput
                                    Number of errors: 1
                                    Errors:
                                    [
  {
    "type": "float_type",
    "loc": [
      "yaw"
    ],
    "msg": "Input should be a valid number",
    "input": null
  }
]
                                
2026-01-21 13:42:12 c91fe47d0149 httpx[29258] INFO HTTP Request: POST http://10.10.100.61:11434/api/chat "HTTP/1.1 200 OK"

Another rejection of nav_to_pose tool:

2026-01-21 13:15:48 c91fe47d0149 rai.initialization.model_initialization[29258] INFO Initializing complex_model: Vendor: ollama, Model: llama3.2
2026-01-21 13:16:56 c91fe47d0149 ROS2Connector[29258] WARNING MultiThreadedExecutor is 66.43 seconds behind. If you see this message frequently, consider switching to SingleThreadedExecutor.
2026-01-21 13:17:21 c91fe47d0149 httpx[29258] INFO HTTP Request: POST http://10.10.100.61:11434/api/chat "HTTP/1.1 200 OK"
2026-01-21 13:17:21 c91fe47d0149 rai.agents.langchain.core.tool_runner[29258] INFO Running tool: navigate_to_pose, args: {'x': -0.2175, 'y': -0.8775, 'yaw': None, 'z': None}
2026-01-21 13:17:21 c91fe47d0149 rai.agents.langchain.core.tool_runner[29258] INFO 
                                    Validation error in tool navigate_to_pose:
                                    NavigateToPoseToolInput
                                    Number of errors: 2
                                    Errors:
                                    [
  {
    "type": "float_type",
    "loc": [
      "z"
    ],
    "msg": "Input should be a valid number",
    "input": null
  },
  {
    "type": "float_type",
    "loc": [
      "yaw"
    ],
    "msg": "Input should be a valid number",
    "input": null
  }
]

Description

Contributor guide

First steps

Research direction

Assessment