google / google/generative-ai-docs

Optimizing PaliGemma to TFLite / TorchScript

Open
#470 5 comments 0 reactions 0 assignees View on GitHub
component:documentation status:triaged type:feature request
Dominant language
Jupyter Notebook
Stars
2.3k
Forks
735
PR merge metrics
No merged PRs in 30d

Description

### Description of the feature request:

Hi, I was wondering if anyone has a conversion script or method that can be used to convert PaliGemma from HuggingFace Transformers to TFLite or TorchScript? Am trying to use it in mobile devices but currently can't seem to find a method that works 100% for this model conversion. Any help is greatly appreciated, thanks!

### What problem are you trying to solve with this feature?

_No response_

### Any other information you'd like to share?

_No response_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.