nextcloud / nextcloud/recognize
Move to better face recognition models
Nobody has claimed this yet.
- Dominant language
- PHP
- Stars
- 699
- Forks
- 68
- Avg merge
- 1d 4h
- Merged PRs (30d)
- 5
Description
Describe the feature you'd like to request
I have installed Recognize together with Memories and so far everything works: Recognize scans my images for faces and groups them together. Great!
Yesterday, just for testing, i set up an instance of immich and loaded the same photo library i have stored in my Nextcloud. Immich currently uses the buffalo_l model from InsightFace for facial recognition, and after scanning i was blown away by the accuracy: The model not only found way more pictures, it was also way better at assigning them to the right person. To give you some numbers: recognize found 706 pictures of me, immich with buffalo_l found 3780 pictures. All correctly assigned with sometimes mind-blowing accuracy.
Since the results were that good, i thought about suggesting replacing of the face recognition model, e.g. with buffalo_l or similar, to further promote Nextcloud as the main storage for photos. I am aware that this is not a one-click replacement and might require a lot of effort or additional work, but as this might also affect ongoing discussions, e.g. https://github.com/nextcloud/recognize/discussions/865 regarding undetected faces, i wanted to share my thoughts with you.
Describe the solution you'd like
Move to an improved face recognition model
Describe alternatives you've considered
--
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
The issue names no files or tests; start by reviewing the current face-recognition implementation and the linked discussion about undetected faces. Compare the existing model with InsightFace's buffalo_l, then define the integration approach and accuracy criteria before implementation.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- machine-learning
- Domain
- computer-vision, machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100