layumi / layumi/Image-Text-Embedding
Problem training on MSCOCO
Nobody has claimed this yet.
- Dominant language
- MATLAB
- Stars
- 296
- Forks
- 72
- PR merge metrics
- No merged PRs in 30d
Description
I am trying to train the model on MSCOCO and run into the following issues:
1- When running 'train_coco_word2_1_pool.m' as you suggest, I get the error that the function 'coco_word2_pool_no_w2v' does not exist.
2- I therefore changed it for 'coco_word2_pool' since this function is indeed in the directory (is this what you meant?). Then I get the following error:
_Error using reshape
To RESHAPE the number of elements must not change.
Error in coco_word2_pool (line 273)
net.params(first).value = reshape(single(subset.features'),1,1,29972,300);
Error in train_coco_word2_1_pool (line 17)
net = coco_word2_pool();_
3- I experience the same issue when running 'train_coco_word2_1_pool_vgg19.m'
4- The reason that I am training is that I want to reproduce your results but the 20 epochs in your pretrained model don't seem to be enough. Are these the parameters that you used to report test results?
I am running the code on a MacBook Pro, on Matlab R2018b.
Thank you in advance.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with train_coco_word2_1_pool.m, train_coco_word2_1_pool_vgg19.m, and coco_word2_pool.m, especially line 273 where the reshape error occurs. Check why coco_word2_1_pool.m refers to the missing coco_word2_pool_no_w2v function and compare the expected feature dimensions with the available data. Done means both training entry points run without these errors and the intended epoch and test-result parameters are documented.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- matlab
- Domain
- computer-vision, machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100