apple / apple/coremltools

Is it possible to add support for Kosmos-2 Model

Open
#2,123 2 comments 0 reactions 0 assignees View on GitHub
question
Dominant language
Python
Stars
5.4k
Forks
850
Avg merge
4d 5h
Merged PRs (30d)
10

Description

Hello Coremltools Team,

I was just checking if It is possible for me to convert "https://huggingface.co/microsoft/kosmos-2-patch14-224" model to support coreml so that I can use it on my mac?

its an Image to Text (Image Captioning Model)

I have tried it now but I could not find any helpful things, Is there any way I or we could add support for this?

Thanks!!!!

## ❓Question

- If this is a question about the Core ML Frame work or Xcode, please ask your question in the Apple Developer Forum: https://developer.apple.com/forums/

Contributor guide

Open the contributing guide

Research direction

Review the linked microsoft/kosmos-2-patch14-224 model and the coremltools conversion capabilities to determine what support would be required. Done would mean establishing whether the image-captioning model can be converted for use on macOS, with any necessary support and validation identified.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.