Accenture / Accenture/AmpliGraph

Reopening issue 222

Open
#223 1 comment 0 reactions 1 assignee View on GitHub

@lukostaz is already working on this.

Since Feb 2, 2021.

Dominant language
Python
Stars
2.2k
Forks
257
PR merge metrics
No merged PRs in 30d

Description

hey, I read the paper suggested. can you please explain why early stopping algorithm should have access to test dataset?

I understand that the final filtered metrics can have access to test dataset (as done in the paper, to report the actual performance), but the paper does not mention stopping early by seeing performance using test dataset (one can use valid dataset to get an estimate of filtered metrics).

Citing the paper by Bordes verbatim: "selected the best model by early stopping using the mean rank on the validation sets (with a total of at most 1,000 epochs over the training data)"

Originally posted by @luffycodes in https://github.com/Accenture/AmpliGraph/issues/222#issuecomment-771786089

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.