allenai / allenai/ai2thor

object visible in the metadata can not seen in the observation image

Aperta
#1,199 0 commenti 0 reazioni 0 assegnatari Vedi su GitHub
Lingua principale
C#
Stelle
1.8k
Fork
296
Metriche di merge delle PR
Nessuna PR unita negli ultimi 30g

Descrizione

Dear author,

I want to use the GetInteractablePoses action to acquire the image that the target object is visible, but I find some positions can not see the target object. Then, I teleport to these positions and rotations, the target object still can not seen in the observation image, but the result of the target object being visible is True.

This is my teleport code:

```
import prior
from ai2thor.controller import Controller
import cv2
import prior

dataset = prior.load_dataset("procthor-10k")
scene_num = 93
scene_name = dataset["train"][scene_num]

controller = Controller(scene=scene_name,
gridSize=0.25,
renderImage=True,
renderDepthImage=True,
renderClassImage=True,
renderObjectImage=True,
visibility_distance=True,
width=640,
height=480,
)
event = controller.step(dict(
action='Initialize',
gridSize=0.25,
renderImage=True,
renderDepthImage=True,
renderClassImage=True,
renderObjectImage=True,
visibility_distance=True,
makeAgentsVisible=False,
horizon=0,
))
position = {'x': 8.0, 'y': 0.9009993672370911, 'z': 4.0}
rotation = {'x': -0.0, 'y': 0.0, 'z': 0.0}
event=controller.step(action="Teleport", rotation=dict(x=0,y=0,z=0), position=position)
rgb = event.frame.copy()
rgb_frame = cv2.cvtColor(rgb, cv2.COLOR_BGR2RGB)
cv2.imwrite("img.png",rgb_frame)
```

this image shows the observation image:
![img](https://github.com/allenai/ai2thor/assets/26397297/063e14a8-d3dc-411d-b673-6616d8657707)

these images show some results of the event.metadata:
![vis_img](https://github.com/allenai/ai2thor/assets/26397297/9fd9d47b-d1f4-4091-a035-b2353c7dc4d1)
![agent_pose](https://github.com/allenai/ai2thor/assets/26397297/31940e4f-87b2-4a4a-bc88-784d3e417b97)
![action_success](https://github.com/allenai/ai2thor/assets/26397297/57e11cfe-3311-4e51-a33d-17849c66b529)

I can not see the armchair in the observation image, but the result of the armchair being visible is True.
Can you help me to solve this problem?
Thanks
Juan

Guida per i contributori

Apri la guida per i contributori

Valutazione

Questa issue non è ancora stata valutata.

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.