carpedm20 / carpedm20/NTM-tensorflow

memory usage

Open
#27 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
1k
Forks
212
PR merge metrics
No merged PRs in 30d

Description

Is this model particularly memory intensive? The model hangs on building the loss model for seq_length 10 having used 16GB of RAM.

This might be caused by the fact that I am using tensorflow 1.0.0-rc1 (because of #26, legacy_seq2seq is present in 1.0.0-rc1 and not 0.12.1). I've modified your code to run on this version, and it trains correctly with lower length sequences, but still eats memory.

Is this normal, or some sort of memory leak caused by the newer version of tensorflow?

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reproducing the reported memory growth while building the loss model with seq_length 10, comparing TensorFlow 1.0.0-rc1 against 0.12.1 if available. Inspect the loss-model construction and the reporter's modified code; done means determining whether the usage is expected or a leak and recording or addressing the cause.

Written by the indexing model from the issue text.

Assessment

Tech stack
tensorflow
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.