nextcloud / nextcloud/recognize
BLIP support
Nobody has claimed this yet.
- Dominant language
- PHP
- Stars
- 699
- Forks
- 68
- Avg merge
- 1d 4h
- Merged PRs (30d)
- 5
Description
Describe the feature you'd like to request
BLIP is a model trained to generate a caption based on the content of an image. Here are the examples of its work.
Describe the solution you'd like
In general, the captioning should be searchable by nextcloud's search feature.
I'm not sure what would be the best way to store the captioning (as a comment to a picture, as a separate .txt file to be created aside?)
Describe alternatives you've considered
I'm unaware of other models that work as good as BLIP.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reviewing how Nextcloud's search feature indexes image-related content and the BLIP model linked in the issue. Decide how generated captions should be stored and exposed to search; done means image captions are generated and searchable without leaving the storage approach ambiguous.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- machine-learning
- Domain
- machine-learning, search
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100