How to Reproduce Evaluation Results??
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 13.7k
- Forks
- 1.3k
- PR merge metrics
- No merged PRs in 30d
Description
@JeffreyXiang @YuDeng @yangjiaolong Can you please provide the evaluation code/scripts used for generation task? I can not find any related functions/classes in the codebase.
Also, it is mentioned in the supplementary material that you use a "subset of Toys4k with 1,250 randomly sampled instances" for generation experiments. Can you please provide the IDs of those assets?
Anyone able to figure this out??
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reviewing the supplementary material and searching the codebase for evaluation or generation-task entry points. The work is complete when the evaluation scripts or their location are documented and the 1,250 Toys4k asset IDs used for generation experiments are provided.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Documentation
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100