automl / automl/RobustDARTS

Different default parameter values than what is mentioned in the paper.

Open
#9 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
158
Forks
39
PR merge metrics
No merged PRs in 30d

Description

Hi

Thanks for the paper and code.

I noticed that a few argument values in search/src/args.py differ from what is mentioned in the paper like max_weight_decay, mul_factor.

Also if I understood it right, in the paper most plots seem to indicate that overfitting is reduced with drop_path_prob >= 0.5, yet the default value of it in code is given 0.2

The value of "factor" parameter (the threshold for eigenvalues) is also different in the paper than code.

Could you please clarify about the good/default value of all these 3 parameters as per your experiments?

Thank You!

Contributor guide

No contributing guide indexed for this repository

Research direction

Inspect search/src/args.py and compare max_weight_decay, mul_factor, drop_path_prob, and factor with the paper's experiments and plots. Confirm the intended defaults for these parameters and document or reconcile the paper/code discrepancy; done means the values and their rationale are clear.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Documentation
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.