facebookresearch / facebookresearch/fairo

[Dashboard] Location tracking in Voxel world is unreliable

Open
#332 1 comment 0 reactions 1 assignee Claimed by @snyxan View on GitHub
feature request
Dominant language
Jupyter Notebook
Stars
929
Forks
123
PR merge metrics
No merged PRs in 30d

Description

## Type of Issue

Select the type of issue:
- [ ] Bug report (to report a bug)
- [x] Feature request (to request an additional feature)
- [ ] Tracker (I am just using this as a tracker)
- [ ] Refactor request
- [ ] Documentation Ask

## Description

Often move commands fail due to errors in location tracking, eg. the speaker position is not updated when they move so "come here" causes the agent to go to the starting position. This also causes other failures like:
- "follow me"
- "build X behind me" -> builds behind speaker's starting position

Another set of errors but not sure if related, is "go to X" sometimes is inaccurate. See:
https://drive.google.com/drive/folders/14OhRRyiX3W25LaduIggTudiWnqL-OA3M

"go between the circles" towards end of recording

## Current Behavior

Speaker's location is not resolved dynamically, plus other location inaccuracies.

## Expected Behavior

Speaker's location updated in real time

## Steps to reproduce

Go to `craftassist.io` and spin up a new container.
Move the speaker around, and ask agent to come to speaker

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.