automl / automl/NASLib

How to use NB301?

Open
#140 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
595
Forks
133
PR merge metrics
No merged PRs in 30d

Description

Hello,

I was trying to use NasBenchmark301 based on the example notebook [here](https://github.com/automl/NASLib/blob/Develop/examples/predictors.md) there are lots of dependency incompatibilities with the NASLib.

It also requires [certain branch](https://github.com/automl/Auto-PyTorch/tree/nb301) of Auto-PyTorch and Auto-Pytorch also has incompatibility issues with the NASLib.

Following the another reference in the NASLib's readme I reached the [nas-bench-x11](https://github.com/automl/nas-bench-x11) repository and it has also some incompatibility issues.

My question is, what is the suggested and proper way to use NB301 benchmarks?

Based on that we are planning to develop a surrogate model for a task.

Thank you in advance,

Contributor guide

Open the contributing guide

Research direction

Start with the examples/predictors.md example and the NASLib README references for NB301, then compare their dependency requirements with the nb301 branch of Auto-PyTorch and the nas-bench-x11 repository. Done means documenting a supported installation and usage path, or clearly identifying the incompatibilities that must be resolved for the NB301 example to run.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Documentation
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.