User position in VW doesn't update in agent memory

## Type of Issue

Select the type of issue:
- [X] Bug report (to report a bug)
- [ ] Feature request (to request an additional feature)
- [ ] Tracker (I am just using this as a tracker)
- [ ] Refactor request
- [ ] Documentation Ask

## Description

The agent treats the user position as static in voxel world. It doesn't update when the user moves around.

## Current Behavior

Commands that reference the user position or look direction don't function as expected. Eg. "come here" always sends the agent to the user starting position.

## Expected Behavior

User position in VW should be reflected in agent memory.