facebookresearch / facebookresearch/jepa
Unknown class detection in the context of Open-Set Recognition
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 4.1k
- Forks
- 424
- PR merge metrics
- No merged PRs in 30d
Description
I am using a pretrained backbone model to extract features from images and utilize these features for unknown class detection in the context of Open-Set Recognition. The output tensor of the backbone is in the form of (batch size, patch size, embedding dimension). Do you have any ideas on how to process this tensor to make it more suitable for unknown class detection? One idea I have is to average the embedding vectors over all patches and consider this as the vector for each image. When visualizing the distribution of these vectors for each image, it seemed to align closely with human perception. If you have any other good ideas, I would appreciate your suggestions.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
The issue names no files, tests, or entry points. Start by locating the pretrained-backbone feature extraction path and reviewing how image features are represented. Compare approaches for unknown-class detection and define completion through a validated evaluation, since the issue currently requests ideas rather than a specific change.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, pytorch
- Domain
- computer-vision, machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100