layumi / layumi/Image-Text-Embedding

CUHK results drops compared to reported numbers.

Open
#10 6 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
MATLAB
Stars
296
Forks
72
PR merge metrics
No merged PRs in 30d

Description

txt-image rank-1:0.384178 mAP:0.354052 Medr:3.000000
txt-image rank-5:0.610136 rank-10:0.703866

which is normally 5-6% lower than reported. I made no change to the parameters, any ideas what could possibly be the reason for the performance drop?

trained on Ubuntu 16.04 LTS Matlab 2015b (preprocessing data on another machine with a higher version for jsondecode support) + cudnn 5.0 with a Titan Xp.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

The issue names no files, tests, or entry points. Start by reproducing the reported CUHK metrics with the stated MATLAB, Ubuntu, cuDNN, Titan Xp, and preprocessing setup, then compare them with the reported numbers and isolate the cause of the 5–6% drop. Done means identifying a reproducible reason for the discrepancy or confirming matching results.

Written by the indexing model from the issue text.

Assessment

Tech stack
matlab, ubuntu
Domain
computer-vision, machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.