carpedm20 / carpedm20/ENAS-pytorch

Best DAG doesn't seem to be saved on it's own

Open
#29 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
2.7k
Forks
486
PR merge metrics
No merged PRs in 30d

Description

I notice that in Trainer.train() self.save_model() is called at certain times to save all of the shared weights in the "super graph" (my terminology), but I don't see that the best dag is tracked such that at the end of train() we have the best DAG/model RNN for the PTB task. save_model() saves all of the weights for the entire shared weight space, but doesn't show which DAG (which sub-graph of the larger graph) represents the best RNN constructed during training - unless I'm missing something?

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by locating Trainer.train() and save_model(), then trace how the PTB task identifies the best DAG or model RNN during training. Determine what saved output should identify the best sub-graph in addition to the shared weights, and verify that the resulting artifact can distinguish that DAG at the end of train().

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
machine-learning
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.