Megvii-BaseDetection / Megvii-BaseDetection/BEVDepth

Depth Appearance From LSS Multiview Backbone

Open
#208 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
881
Forks
124
PR merge metrics
No merged PRs in 30d

Description

Hi, I've been trying to utilize your implementation of multiview LSS backbone for my thesis. I was wondering if the returned depth should be visually interpretable. I am aware that the depth tensor is spatially downsampled from original input images, but still I expect to get coarse depth image. Right now i just get a full noise like image(see image below) after decoding depth bins to meters (argmax(depths) * bin_size). I was expecting to see something like depth net output vis here

Image

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the multiview LSS backbone's returned depth tensor and the reported decoding expression, argmax(depths) * bin_size; compare its behavior with the depth-net visualization in the MatrixVT README linked in the issue. Done means determining whether the decoded result should be a coarse visual depth image and documenting or correcting the cause of the reported noise.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
computer-vision, machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
32/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.