huggingface / huggingface/pytorch-image-models

[FEATURE] Support variable input size of maxvit and coatnet

Open
#1,475 1 comment 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Python
Stars
37.1k
Forks
5.2k
Avg merge
1d 13h
Merged PRs (30d)
34

Description

Will it be possible in the future to support variable input sizes for maxvit and coatnet?

I am experimenting with adapting various models of timm to self-supervised learning such as DINO and iBOT.
When learning these, it is necessary to accept inputs of (224,224,3) and (96,96,3) at the same time.

[The model](https://github.com/bytedance/ibot/tree/main/models) here seems to support variable sizes. If you're not going to break the implementation, I'd love to see you add support for variable sizes.

Contributor guide

Open the contributing guide

Research direction

Start by locating the MaxViT and CoAtNet model implementations and reviewing how their input sizes are handled. Check both (224, 224, 3) and (96, 96, 3) inputs, including simultaneous use for self-supervised learning, and verify that existing model behavior is not broken.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
computer-vision, machine-learning
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.