localminimum / localminimum/QANet

This repo cannot reproduce the result of original paper

Open
#49 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
985
Forks
297
PR merge metrics
No merged PRs in 30d

Description

Thank you for your implementation, it is very helpful for me.
I run this code and can get the similar result when the number of heads equals to 1. But, I cannot get the result of original paper(73.6/82.7) when I use 8 heads, batch size 32, training step 150k, char dimension of 200 (the same setting as the original paper). I can only get around (71.27/80.58).
Same situation was ocurred when I ran the pytorch repo (https://github.com/andy840314/QANet-pytorch-).

Any suggestions?

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reproducing the reported run with 8 heads, batch size 32, 150k training steps, and character dimension 200, then compare its result with the original paper's 73.6/82.7 figures. The issue provides no file, test, or entry point; done would require identifying why both implementations reach only about 71.27/80.58 or documenting the confirmed cause.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch, tensorflow
Domain
machine-learning
Issue type
Bug
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.