huggingface / huggingface/pixparse

[Explore] Vision architecture comparisons at 1280x960

Open
#7 1 comment 0 reactions 1 assignee Claimed by @molbap View on GitHub
enhancement
Dominant language
Python
Stars
25
Forks
4
PR merge metrics
No merged PRs in 30d

Description

There are many possible vision arch to try other than the Donut choice of swin v1 or the common choice of vanilla (or modified) vit. Should make an effort to explore the options as we run experiments.

NOTE: exact weight instances TBD

* vit_base (original, clip, eva, beit variants)
* `vit_base_patch16_224.augreg_in21k`
* `vit_base_patch16_clip_224.datacompxl`
* `eva02_base_patch14_224.mim_in22k`
* convnext_base (w/o attention pooling)
* `convnext_base.clip_laiona_augreg_320`
* `convnext_base.fb_in22k`
* convnext_base (w/ attention pooling, needs work)
* TBD
* swin_base
*
* swinv2_base
*
* maxvit_small_tf
*
* maxvit_rmlp_small_rw
*
* coatnet_rmlp_2_rw_224
*

Possibly
* visformer_small
* davit_base
* caformer_b36 / caformer_m36
* convformer_b36 / convformer_b36

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.