facebookresearch / facebookresearch/co-tracker

How to run the online tracker for every frame?

Open
#56 4 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
5.1k
Forks
389
PR merge metrics
No merged PRs in 30d

Description

In the online demo, the tracker runs on every 4th step because of this if-clause in [online_demo.py](https://github.com/facebookresearch/co-tracker/blob/main/online_demo.py):

```python
if i % model.step == 0 and i != 0:
_process_step(...)
```

Is it possible to run the tracker on every frame somehow?
I tried adjusting the `model.window_len` which ultimately determines `model.step`, but could not figure out a working solution somehow.

Contributor guide

Open the contributing guide

Research direction

Start with online_demo.py and inspect the if-clause around model.step and the _process_step(...) call. Run the online demo to confirm the current every-fourth-step behavior, then determine how to invoke the tracker on every frame while preserving the demo's online tracking behavior. Done means the tracker processes each frame and the demo still runs successfully.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
computer-vision, machine-learning
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
42/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.