huggingface / huggingface/evaluate

need evaluator code reference for object detector & zero shot object dector task

Open
#552 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
2.5k
Forks
341
PR merge metrics
No merged PRs in 30d

Description

Hi Team,

i use google/owlvit-base-patch32 model for zero shot object detection.

To evaluate the model performance and speed, i like to use a evaluator for Zero Shot Object Detector task.

Currently it is supported only for limited tasks ( https://huggingface.co/docs/evaluate/base_evaluator) .

Like to know is there any evaluator available for ( Zero Shot Object Detector tasks)

https://www.philschmid.de/optimizing-transformers-with-optimum contains this code for text-classification task.

thanks

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.