CSAILVision / CSAILVision/LabelMeAnnotationTool

Suggestion : M-turk like feature but in a Local server

Open
#47 1 comment 1 reaction 0 assignees View on GitHub
Dominant language
JavaScript
Stars
1.5k
Forks
443
PR merge metrics
No merged PRs in 30d

Description

Hey guys, thanks for the awesome annotation tool.
1) Is there a way to use Label-Me similar to M-turk mode but used within the organisation via LAN?. I mean asking the human workers in the organisation to label the images using Label-Me which is running on a local server?
2) One idea to make the above possible is to host label me on a local server and ask the workers to sign in with different usernames and label
3) The main problem is in determining the accuracy of the labelling by different workers . Is it possible to do something like [this ](https://blog.mturk.com/tutorial-measuring-the-accuracy-of-bounding-box-image-annotations-from-mturk-ad3dfcdf8aa0) using label me?

or any other suggestions on determining the accuracy of labelling?
Thanks in advance.

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue names no files, tests, or entry points. Start by reviewing the LabelMe project structure and how it is hosted, then determine whether the proposed LAN workflow, separate usernames, and annotation-accuracy measurement have defined entry points. Done requires an agreed scope and design for the local multi-user feature and its accuracy metric.

Written by the indexing model from the issue text.

Assessment

Tech stack
javascript
Domain
backend, computer-vision
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.