tensorflow / tensorflow/models
Unresolved object in detection/segmentation layers when loading the suggested MaskRCNN pretrained model
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 77.7k
- Forks
- 44.8k
- PR merge metrics
- No merged PRs in 30d
Description
Prerequisites
Please answer the following questions for yourself before submitting an issue.
- [X ] I am using the latest TensorFlow Model Garden release and TensorFlow 2.
- [X ] I am reporting the issue to the correct repository. (Model Garden official or research directory)
- [X ] I checked to make sure that this issue has not already been filed.
1. The entire URL of the file you are using
2. Describe the bug
I am trying to train an instance segmentation model in Google Colab using Tensorflow's Object Detection API, the Oxford Pets dataset and the only pretrained model for mask inference in tf2, which is the Inception Resnet V2 run on COCO17. When loading the pretrained model as specified in the config file (modified version of mask_rcnn_inception_resnet_v2_1024x1024_coco17_gpu-8.config) the layers concerning the detection (three stages) give an 'Unresolved object' error. The same doesn't happen when using the model for classification only. Also, it's evident from the logs posted that the loss values appear to have significant variance and fail to quickly converge to a minimum, something that doesn't occur when using the same version of the pretrained model in the tf1 version.
3. Steps to reproduce
The full steps to reproduce this are described in the link above, which indicates to a github notebook run in Google Colab using a GPU instance.
4. Expected behavior
Normally, the model would load up without showing any errors since the rest of the config values appear to be correct and following the official documentation instructions.
5. Additional context
The logs from the begining of a training session, running object_detection/model_main_tf2.py from the research folder.
2020-10-29 12:41:35.915849: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcudart.so.10.1
2020-10-29 12:41:43.102055: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcuda.so.1
2020-10-29 12:41:43.148722: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:982] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2020-10-29 12:41:43.149396: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1716] Found device 0 with properties:
pciBusID: 0000:00:04.0 name: Tesla P100-PCIE-16GB computeCapability: 6.0
coreClock: 1.3285GHz coreCount: 56 deviceMemorySize: 15.90GiB deviceMemoryBandwidth: 681.88GiB/s
2020-10-29 12:41:43.149449: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcudart.so.10.1
2020-10-29 12:41:43.380075: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcublas.so.10
2020-10-29 12:41:43.508883: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcufft.so.10
2020-10-29 12:41:43.528175: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcurand.so.10
2020-10-29 12:41:43.809008: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcusolver.so.10
2020-10-29 12:41:43.836837: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcusparse.so.10
2020-10-29 12:41:44.376161: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcudnn.so.7
2020-10-29 12:41:44.376426: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:982] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2020-10-29 12:41:44.377213: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:982] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2020-10-29 12:41:44.377795: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1858] Adding visible gpu devices: 0
2020-10-29 12:41:44.421954: I tensorflow/core/platform/profile_utils/cpu_utils.cc:104] CPU Frequency: 2200000000 Hz
2020-10-29 12:41:44.422204: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x2295480 initialized for platform Host (this does not guarantee that XLA will be used). Devices:
2020-10-29 12:41:44.422240: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version
2020-10-29 12:41:44.548412: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:982] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2020-10-29 12:41:44.549198: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x2295640 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices:
2020-10-29 12:41:44.549234: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Tesla P100-PCIE-16GB, Compute Capability 6.0
2020-10-29 12:41:44.549622: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:982] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2020-10-29 12:41:44.550254: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1716] Found device 0 with properties:
pciBusID: 0000:00:04.0 name: Tesla P100-PCIE-16GB computeCapability: 6.0
coreClock: 1.3285GHz coreCount: 56 deviceMemorySize: 15.90GiB deviceMemoryBandwidth: 681.88GiB/s
2020-10-29 12:41:44.550304: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcudart.so.10.1
2020-10-29 12:41:44.550367: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcublas.so.10
2020-10-29 12:41:44.550393: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcufft.so.10
2020-10-29 12:41:44.550421: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcurand.so.10
2020-10-29 12:41:44.550450: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcusolver.so.10
2020-10-29 12:41:44.550474: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcusparse.so.10
2020-10-29 12:41:44.550497: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcudnn.so.7
2020-10-29 12:41:44.550588: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:982] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2020-10-29 12:41:44.551258: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:982] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2020-10-29 12:41:44.551820: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1858] Adding visible gpu devices: 0
2020-10-29 12:41:44.555593: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcudart.so.10.1
2020-10-29 12:41:48.541292: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1257] Device interconnect StreamExecutor with strength 1 edge matrix:
2020-10-29 12:41:48.541359: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1263] 0
2020-10-29 12:41:48.541373: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1276] 0: N
2020-10-29 12:41:48.596747: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:982] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2020-10-29 12:41:48.597575: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:982] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2020-10-29 12:41:48.598206: W tensorflow/core/common_runtime/gpu/gpu_bfc_allocator.cc:39] Overriding allow_growth setting because the TF_FORCE_GPU_ALLOW_GROWTH environment variable is set. Original config value was 0.
2020-10-29 12:41:48.598269: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1402] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 14968 MB memory) -> physical GPU (device: 0, name: Tesla P100-PCIE-16GB, pci bus id: 0000:00:04.0, compute capability: 6.0)
INFO:tensorflow:Using MirroredStrategy with devices ('/job:localhost/replica:0/task:0/device:GPU:0',)
I1029 12:41:48.605711 140542339364736 mirrored_strategy.py:341] Using MirroredStrategy with devices ('/job:localhost/replica:0/task:0/device:GPU:0',)
INFO:tensorflow:Maybe overwriting train_steps: 25000
I1029 12:41:48.615905 140542339364736 config_util.py:552] Maybe overwriting train_steps: 25000
INFO:tensorflow:Maybe overwriting use_bfloat16: False
I1029 12:41:48.616161 140542339364736 config_util.py:552] Maybe overwriting use_bfloat16: False
INFO:tensorflow:Reading unweighted datasets: ['data/tfrecords/pets_fullbody_with_masks_train.record-?????-of-00010']
I1029 12:41:48.723080 140542339364736 dataset_builder.py:148] Reading unweighted datasets: ['data/tfrecords/pets_fullbody_with_masks_train.record-?????-of-00010']
INFO:tensorflow:Reading record datasets for input file: ['data/tfrecords/pets_fullbody_with_masks_train.record-?????-of-00010']
I1029 12:41:48.731908 140542339364736 dataset_builder.py:77] Reading record datasets for input file: ['data/tfrecords/pets_fullbody_with_masks_train.record-?????-of-00010']
INFO:tensorflow:Number of filenames to read: 10
I1029 12:41:48.732144 140542339364736 dataset_builder.py:78] Number of filenames to read: 10
WARNING:tensorflow:num_readers has been reduced to 10 to match input file shards.
W1029 12:41:48.732249 140542339364736 dataset_builder.py:86] num_readers has been reduced to 10 to match input file shards.
WARNING:tensorflow:From /content/drive/My Drive/models/research/object_detection/builders/dataset_builder.py:103: parallel_interleave (from tensorflow.python.data.experimental.ops.interleave_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use `tf.data.Dataset.interleave(map_func, cycle_length, block_length, num_parallel_calls=tf.data.experimental.AUTOTUNE)` instead. If sloppy execution is desired, use `tf.data.Options.experimental_deterministic`.
W1029 12:41:48.748920 140542339364736 deprecation.py:323] From /content/drive/My Drive/models/research/object_detection/builders/dataset_builder.py:103: parallel_interleave (from tensorflow.python.data.experimental.ops.interleave_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use `tf.data.Dataset.interleave(map_func, cycle_length, block_length, num_parallel_calls=tf.data.experimental.AUTOTUNE)` instead. If sloppy execution is desired, use `tf.data.Options.experimental_deterministic`.
WARNING:tensorflow:From /content/drive/My Drive/models/research/object_detection/builders/dataset_builder.py:222: DatasetV1.map_with_legacy_function (from tensorflow.python.data.ops.dataset_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use `tf.data.Dataset.map()
W1029 12:41:48.818962 140542339364736 deprecation.py:323] From /content/drive/My Drive/models/research/object_detection/builders/dataset_builder.py:222: DatasetV1.map_with_legacy_function (from tensorflow.python.data.ops.dataset_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use `tf.data.Dataset.map()
WARNING:tensorflow:From /content/drive/My Drive/models/research/object_detection/data_decoders/tf_example_decoder.py:716: calling map_fn (from tensorflow.python.ops.map_fn) with dtype is deprecated and will be removed in a future version.
Instructions for updating:
Use fn_output_signature instead
W1029 12:41:50.524573 140542339364736 deprecation.py:506] From /content/drive/My Drive/models/research/object_detection/data_decoders/tf_example_decoder.py:716: calling map_fn (from tensorflow.python.ops.map_fn) with dtype is deprecated and will be removed in a future version.
Instructions for updating:
Use fn_output_signature instead
WARNING:tensorflow:From /usr/local/lib/python3.6/dist-packages/tensorflow/python/util/dispatch.py:201: sparse_to_dense (from tensorflow.python.ops.sparse_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Create a `tf.sparse.SparseTensor` and use `tf.sparse.to_dense` instead.
W1029 12:41:56.512238 140542339364736 deprecation.py:323] From /usr/local/lib/python3.6/dist-packages/tensorflow/python/util/dispatch.py:201: sparse_to_dense (from tensorflow.python.ops.sparse_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Create a `tf.sparse.SparseTensor` and use `tf.sparse.to_dense` instead.
WARNING:tensorflow:From /content/drive/My Drive/models/research/object_detection/inputs.py:262: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use `tf.cast` instead.
W1029 12:41:59.396601 140542339364736 deprecation.py:323] From /content/drive/My Drive/models/research/object_detection/inputs.py:262: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use `tf.cast` instead.
WARNING:tensorflow:From /content/drive/My Drive/models/research/object_detection/model_lib_v2.py:355: set_learning_phase (from tensorflow.python.keras.backend) is deprecated and will be removed after 2020-10-11.
Instructions for updating:
Simply pass a True/False value to the `training` argument of the `__call__` method of your layer or model.
W1029 12:42:12.145262 140538675808000 deprecation.py:323] From /content/drive/My Drive/models/research/object_detection/model_lib_v2.py:355: set_learning_phase (from tensorflow.python.keras.backend) is deprecated and will be removed after 2020-10-11.
Instructions for updating:
Simply pass a True/False value to the `training` argument of the `__call__` method of your layer or model.
INFO:tensorflow:depth of additional conv before box predictor: 0
I1029 12:42:22.530323 140538675808000 convolutional_keras_box_predictor.py:154] depth of additional conv before box predictor: 0
WARNING:tensorflow:From /usr/local/lib/python3.6/dist-packages/tensorflow/python/util/dispatch.py:201: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version.
Instructions for updating:
box_ind is deprecated, use box_indices instead
W1029 12:42:28.364272 140538675808000 deprecation.py:506] From /usr/local/lib/python3.6/dist-packages/tensorflow/python/util/dispatch.py:201: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version.
Instructions for updating:
box_ind is deprecated, use box_indices instead
WARNING:tensorflow:From /content/drive/My Drive/models/research/object_detection/utils/model_util.py:57: Tensor.experimental_ref (from tensorflow.python.framework.ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use ref() instead.
W1029 12:42:29.090406 140538675808000 deprecation.py:323] From /content/drive/My Drive/models/research/object_detection/utils/model_util.py:57: Tensor.experimental_ref (from tensorflow.python.framework.ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use ref() instead.
WARNING:tensorflow:From /usr/local/lib/python3.6/dist-packages/tensorflow/python/util/dispatch.py:201: batch_gather (from tensorflow.python.ops.array_ops) is deprecated and will be removed after 2017-10-25.
Instructions for updating:
`tf.batch_gather` is deprecated, please use `tf.gather` with `batch_dims=-1` instead.
W1029 12:42:33.663518 140538675808000 deprecation.py:323] From /usr/local/lib/python3.6/dist-packages/tensorflow/python/util/dispatch.py:201: batch_gather (from tensorflow.python.ops.array_ops) is deprecated and will be removed after 2017-10-25.
Instructions for updating:
`tf.batch_gather` is deprecated, please use `tf.gather` with `batch_dims=-1` instead.
WARNING:tensorflow:From /usr/local/lib/python3.6/dist-packages/tensorflow/python/util/dispatch.py:201: softmax_cross_entropy_with_logits (from tensorflow.python.ops.nn_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Future major versions of TensorFlow will allow gradients to flow
into the labels input on backprop by default.
See `tf.nn.softmax_cross_entropy_with_logits_v2`.
W1029 12:42:38.676525 140538675808000 deprecation.py:323] From /usr/local/lib/python3.6/dist-packages/tensorflow/python/util/dispatch.py:201: softmax_cross_entropy_with_logits (from tensorflow.python.ops.nn_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Future major versions of TensorFlow will allow gradients to flow
into the labels input on backprop by default.
See `tf.nn.softmax_cross_entropy_with_logits_v2`.
2020-10-29 12:42:58.351430: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcublas.so.10
2020-10-29 12:42:59.798456: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcudnn.so.7
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._groundtruth_lists
W1029 12:43:17.745995 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._groundtruth_lists
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._first_stage_box_predictor_first_conv
W1029 12:43:17.746352 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._first_stage_box_predictor_first_conv
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._first_stage_box_predictor
W1029 12:43:17.746454 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._first_stage_box_predictor
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._maxpool_layer
W1029 12:43:17.746539 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._maxpool_layer
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor
W1029 12:43:17.746614 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._batched_prediction_tensor_names
W1029 12:43:17.746687 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._batched_prediction_tensor_names
WARNING:tensorflow:Unresolved object in checkpoint: (root).model.endpoints
W1029 12:43:17.746758 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model.endpoints
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._first_stage_box_predictor_first_conv.layer_with_weights-0
W1029 12:43:17.746841 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._first_stage_box_predictor_first_conv.layer_with_weights-0
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._first_stage_box_predictor_first_conv.layer-1
W1029 12:43:17.746940 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._first_stage_box_predictor_first_conv.layer-1
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._first_stage_box_predictor_first_conv.layer-2
W1029 12:43:17.747037 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._first_stage_box_predictor_first_conv.layer-2
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._first_stage_box_predictor._prediction_heads
W1029 12:43:17.747113 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._first_stage_box_predictor._prediction_heads
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._first_stage_box_predictor._sorted_head_names
W1029 12:43:17.747189 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._first_stage_box_predictor._sorted_head_names
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._first_stage_box_predictor._shared_nets
W1029 12:43:17.747269 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._first_stage_box_predictor._shared_nets
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._box_prediction_head
W1029 12:43:17.747357 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._box_prediction_head
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._class_prediction_head
W1029 12:43:17.747442 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._class_prediction_head
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._third_stage_heads
W1029 12:43:17.747526 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._third_stage_heads
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._first_stage_box_predictor_first_conv.layer_with_weights-0._inbound_nodes
W1029 12:43:17.747784 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._first_stage_box_predictor_first_conv.layer_with_weights-0._inbound_nodes
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._first_stage_box_predictor_first_conv.layer_with_weights-0.kernel
W1029 12:43:17.747961 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._first_stage_box_predictor_first_conv.layer_with_weights-0.kernel
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._first_stage_box_predictor_first_conv.layer_with_weights-0.bias
W1029 12:43:17.748074 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._first_stage_box_predictor_first_conv.layer_with_weights-0.bias
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._first_stage_box_predictor_first_conv.layer-1._inbound_nodes
W1029 12:43:17.748175 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._first_stage_box_predictor_first_conv.layer-1._inbound_nodes
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._first_stage_box_predictor_first_conv.layer-2._inbound_nodes
W1029 12:43:17.748270 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._first_stage_box_predictor_first_conv.layer-2._inbound_nodes
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._first_stage_box_predictor._prediction_heads.box_encodings
W1029 12:43:17.748359 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._first_stage_box_predictor._prediction_heads.box_encodings
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._first_stage_box_predictor._prediction_heads.class_predictions_with_background
W1029 12:43:17.748431 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._first_stage_box_predictor._prediction_heads.class_predictions_with_background
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._first_stage_box_predictor._shared_nets.0
W1029 12:43:17.748501 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._first_stage_box_predictor._shared_nets.0
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._box_prediction_head._box_encoder_layers
W1029 12:43:17.748570 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._box_prediction_head._box_encoder_layers
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._class_prediction_head._class_predictor_layers
W1029 12:43:17.748638 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._class_prediction_head._class_predictor_layers
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._third_stage_heads.mask_predictions
W1029 12:43:17.748705 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._third_stage_heads.mask_predictions
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._first_stage_box_predictor._prediction_heads.box_encodings.0
W1029 12:43:17.748944 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._first_stage_box_predictor._prediction_heads.box_encodings.0
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._first_stage_box_predictor._prediction_heads.class_predictions_with_background.0
W1029 12:43:17.749029 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._first_stage_box_predictor._prediction_heads.class_predictions_with_background.0
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._box_prediction_head._box_encoder_layers.0
W1029 12:43:17.749102 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._box_prediction_head._box_encoder_layers.0
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._box_prediction_head._box_encoder_layers.1
W1029 12:43:17.749172 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._box_prediction_head._box_encoder_layers.1
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._box_prediction_head._box_encoder_layers.2
W1029 12:43:17.749240 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._box_prediction_head._box_encoder_layers.2
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._class_prediction_head._class_predictor_layers.0
W1029 12:43:17.749310 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._class_prediction_head._class_predictor_layers.0
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._class_prediction_head._class_predictor_layers.1
W1029 12:43:17.749380 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._class_prediction_head._class_predictor_layers.1
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._class_prediction_head._class_predictor_layers.2
W1029 12:43:17.749447 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._class_prediction_head._class_predictor_layers.2
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._third_stage_heads.mask_predictions._mask_predictor_layers
W1029 12:43:17.749514 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._third_stage_heads.mask_predictions._mask_predictor_layers
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._first_stage_box_predictor._prediction_heads.box_encodings.0._box_encoder_layers
W1029 12:43:17.749600 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._first_stage_box_predictor._prediction_heads.box_encodings.0._box_encoder_layers
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._first_stage_box_predictor._prediction_heads.class_predictions_with_background.0._class_predictor_layers
W1029 12:43:17.749671 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._first_stage_box_predictor._prediction_heads.class_predictions_with_background.0._class_predictor_layers
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._box_prediction_head._box_encoder_layers.1.kernel
W1029 12:43:17.749747 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._box_prediction_head._box_encoder_layers.1.kernel
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._box_prediction_head._box_encoder_layers.1.bias
W1029 12:43:17.749822 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._box_prediction_head._box_encoder_layers.1.bias
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._class_prediction_head._class_predictor_layers.1.kernel
W1029 12:43:17.749911 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._class_prediction_head._class_predictor_layers.1.kernel
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._class_prediction_head._class_predictor_layers.1.bias
W1029 12:43:17.749983 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._class_prediction_head._class_predictor_layers.1.bias
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._third_stage_heads.mask_predictions._mask_predictor_layers.0
W1029 12:43:17.750051 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._third_stage_heads.mask_predictions._mask_predictor_layers.0
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._third_stage_heads.mask_predictions._mask_predictor_layers.1
W1029 12:43:17.750119 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._third_stage_heads.mask_predictions._mask_predictor_layers.1
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._third_stage_heads.mask_predictions._mask_predictor_layers.2
W1029 12:43:17.750194 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._third_stage_heads.mask_predictions._mask_predictor_layers.2
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._third_stage_heads.mask_predictions._mask_predictor_layers.3
W1029 12:43:17.750262 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._third_stage_heads.mask_predictions._mask_predictor_layers.3
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._third_stage_heads.mask_predictions._mask_predictor_layers.4
W1029 12:43:17.750329 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._third_stage_heads.mask_predictions._mask_predictor_layers.4
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._third_stage_heads.mask_predictions._mask_predictor_layers.5
W1029 12:43:17.750397 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._third_stage_heads.mask_predictions._mask_predictor_layers.5
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._third_stage_heads.mask_predictions._mask_predictor_layers.6
W1029 12:43:17.750464 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._third_stage_heads.mask_predictions._mask_predictor_layers.6
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._third_stage_heads.mask_predictions._mask_predictor_layers.7
W1029 12:43:17.750532 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._third_stage_heads.mask_predictions._mask_predictor_layers.7
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._third_stage_heads.mask_predictions._mask_predictor_layers.8
W1029 12:43:17.750599 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._third_stage_heads.mask_predictions._mask_predictor_layers.8
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._third_stage_heads.mask_predictions._mask_predictor_layers.9
W1029 12:43:17.750666 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._third_stage_heads.mask_predictions._mask_predictor_layers.9
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._first_stage_box_predictor._prediction_heads.box_encodings.0._box_encoder_layers.0
W1029 12:43:17.750734 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._first_stage_box_predictor._prediction_heads.box_encodings.0._box_encoder_layers.0
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._first_stage_box_predictor._prediction_heads.class_predictions_with_background.0._class_predictor_layers.0
W1029 12:43:17.750806 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._first_stage_box_predictor._prediction_heads.class_predictions_with_background.0._class_predictor_layers.0
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._third_stage_heads.mask_predictions._mask_predictor_layers.0.kernel
W1029 12:43:17.750889 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._third_stage_heads.mask_predictions._mask_predictor_layers.0.kernel
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._third_stage_heads.mask_predictions._mask_predictor_layers.0.bias
W1029 12:43:17.750962 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._third_stage_heads.mask_predictions._mask_predictor_layers.0.bias
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._third_stage_heads.mask_predictions._mask_predictor_layers.3.kernel
W1029 12:43:17.751034 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._third_stage_heads.mask_predictions._mask_predictor_layers.3.kernel
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._third_stage_heads.mask_predictions._mask_predictor_layers.3.bias
W1029 12:43:17.751106 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._third_stage_heads.mask_predictions._mask_predictor_layers.3.bias
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._third_stage_heads.mask_predictions._mask_predictor_layers.6.kernel
W1029 12:43:17.751177 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._third_stage_heads.mask_predictions._mask_predictor_layers.6.kernel
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._third_stage_heads.mask_predictions._mask_predictor_layers.6.bias
W1029 12:43:17.751248 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._third_stage_heads.mask_predictions._mask_predictor_layers.6.bias
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._third_stage_heads.mask_predictions._mask_predictor_layers.9.kernel
W1029 12:43:17.751318 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._third_stage_heads.mask_predictions._mask_predictor_layers.9.kernel
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._third_stage_heads.mask_predictions._mask_predictor_layers.9.bias
W1029 12:43:17.751392 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._mask_rcnn_box_predictor._third_stage_heads.mask_predictions._mask_predictor_layers.9.bias
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._first_stage_box_predictor._prediction_heads.box_encodings.0._box_encoder_layers.0.kernel
W1029 12:43:17.751463 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._first_stage_box_predictor._prediction_heads.box_encodings.0._box_encoder_layers.0.kernel
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._first_stage_box_predictor._prediction_heads.box_encodings.0._box_encoder_layers.0.bias
W1029 12:43:17.751533 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._first_stage_box_predictor._prediction_heads.box_encodings.0._box_encoder_layers.0.bias
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._first_stage_box_predictor._prediction_heads.class_predictions_with_background.0._class_predictor_layers.0.kernel
W1029 12:43:17.751603 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._first_stage_box_predictor._prediction_heads.class_predictions_with_background.0._class_predictor_layers.0.kernel
WARNING:tensorflow:Unresolved object in checkpoint: (root).model._first_stage_box_predictor._prediction_heads.class_predictions_with_background.0._class_predictor_layers.0.bias
W1029 12:43:17.751675 140542339364736 util.py:150] Unresolved object in checkpoint: (root).model._first_stage_box_predictor._prediction_heads.class_predictions_with_background.0._class_predictor_layers.0.bias
WARNING:tensorflow:A checkpoint was restored (e.g. tf.train.Checkpoint.restore or tf.keras.Model.load_weights) but not all checkpointed values were used. See above for specific issues. Use expect_partial() on the load status object, e.g. tf.train.Checkpoint.restore(...).expect_partial(), to silence these warnings, or use assert_consumed() to make the check explicit. See https://www.tensorflow.org/guide/checkpoint#loading_mechanics for details.
W1029 12:43:17.751750 140542339364736 util.py:158] A checkpoint was restored (e.g. tf.train.Checkpoint.restore or tf.keras.Model.load_weights) but not all checkpointed values were used. See above for specific issues. Use expect_partial() on the load status object, e.g. tf.train.Checkpoint.restore(...).expect_partial(), to silence these warnings, or use assert_consumed() to make the check explicit. See https://www.tensorflow.org/guide/checkpoint#loading_mechanics for details.
INFO:tensorflow:Reduce to /job:localhost/replica:0/task:0/device:CPU:0 then broadcast to ('/job:localhost/replica:0/task:0/device:CPU:0',).
I1029 12:43:18.573943 140542339364736 cross_device_ops.py:443] Reduce to /job:localhost/replica:0/task:0/device:CPU:0 then broadcast to ('/job:localhost/replica:0/task:0/device:CPU:0',).
INFO:tensorflow:Reduce to /job:localhost/replica:0/task:0/device:CPU:0 then broadcast to ('/job:localhost/replica:0/task:0/device:CPU:0',).
I1029 12:43:18.575315 140542339364736 cross_device_ops.py:443] Reduce to /job:localhost/replica:0/task:0/device:CPU:0 then broadcast to ('/job:localhost/replica:0/task:0/device:CPU:0',).
INFO:tensorflow:Reduce to /job:localhost/replica:0/task:0/device:CPU:0 then broadcast to ('/job:localhost/replica:0/task:0/device:CPU:0',).
I1029 12:43:18.576882 140542339364736 cross_device_ops.py:443] Reduce to /job:localhost/replica:0/task:0/device:CPU:0 then broadcast to ('/job:localhost/replica:0/task:0/device:CPU:0',).
INFO:tensorflow:Reduce to /job:localhost/replica:0/task:0/device:CPU:0 then broadcast to ('/job:localhost/replica:0/task:0/device:CPU:0',).
I1029 12:43:18.577743 140542339364736 cross_device_ops.py:443] Reduce to /job:localhost/replica:0/task:0/device:CPU:0 then broadcast to ('/job:localhost/replica:0/task:0/device:CPU:0',).
INFO:tensorflow:Reduce to /job:localhost/replica:0/task:0/device:CPU:0 then broadcast to ('/job:localhost/replica:0/task:0/device:CPU:0',).
I1029 12:43:18.579210 140542339364736 cross_device_ops.py:443] Reduce to /job:localhost/replica:0/task:0/device:CPU:0 then broadcast to ('/job:localhost/replica:0/task:0/device:CPU:0',).
INFO:tensorflow:Reduce to /job:localhost/replica:0/task:0/device:CPU:0 then broadcast to ('/job:localhost/replica:0/task:0/device:CPU:0',).
I1029 12:43:18.580068 140542339364736 cross_device_ops.py:443] Reduce to /job:localhost/replica:0/task:0/device:CPU:0 then broadcast to ('/job:localhost/replica:0/task:0/device:CPU:0',).
INFO:tensorflow:Reduce to /job:localhost/replica:0/task:0/device:CPU:0 then broadcast to ('/job:localhost/replica:0/task:0/device:CPU:0',).
I1029 12:43:18.581517 140542339364736 cross_device_ops.py:443] Reduce to /job:localhost/replica:0/task:0/device:CPU:0 then broadcast to ('/job:localhost/replica:0/task:0/device:CPU:0',).
INFO:tensorflow:Reduce to /job:localhost/replica:0/task:0/device:CPU:0 then broadcast to ('/job:localhost/replica:0/task:0/device:CPU:0',).
I1029 12:43:18.582372 140542339364736 cross_device_ops.py:443] Reduce to /job:localhost/replica:0/task:0/device:CPU:0 then broadcast to ('/job:localhost/replica:0/task:0/device:CPU:0',).
INFO:tensorflow:Reduce to /job:localhost/replica:0/task:0/device:CPU:0 then broadcast to ('/job:localhost/replica:0/task:0/device:CPU:0',).
I1029 12:43:18.584118 140542339364736 cross_device_ops.py:443] Reduce to /job:localhost/replica:0/task:0/device:CPU:0 then broadcast to ('/job:localhost/replica:0/task:0/device:CPU:0',).
INFO:tensorflow:Reduce to /job:localhost/replica:0/task:0/device:CPU:0 then broadcast to ('/job:localhost/replica:0/task:0/device:CPU:0',).
I1029 12:43:18.584976 140542339364736 cross_device_ops.py:443] Reduce to /job:localhost/replica:0/task:0/device:CPU:0 then broadcast to ('/job:localhost/replica:0/task:0/device:CPU:0',).
WARNING:tensorflow:From /usr/local/lib/python3.6/dist-packages/tensorflow/python/util/deprecation.py:574: calling map_fn_v2 (from tensorflow.python.ops.map_fn) with dtype is deprecated and will be removed in a future version.
Instructions for updating:
Use fn_output_signature instead
W1029 12:43:33.104528 140538684200704 deprecation.py:506] From /usr/local/lib/python3.6/dist-packages/tensorflow/python/util/deprecation.py:574: calling map_fn_v2 (from tensorflow.python.ops.map_fn) with dtype is deprecated and will be removed in a future version.
Instructions for updating:
Use fn_output_signature instead
INFO:tensorflow:Step 100 per-step time 0.519s loss=0.821
I1029 12:44:54.390542 140542339364736 model_lib_v2.py:652] Step 100 per-step time 0.519s loss=0.821
INFO:tensorflow:Step 200 per-step time 0.586s loss=0.679
I1029 12:45:46.823013 140542339364736 model_lib_v2.py:652] Step 200 per-step time 0.586s loss=0.679
INFO:tensorflow:Step 300 per-step time 0.496s loss=0.383
I1029 12:46:39.080652 140542339364736 model_lib_v2.py:652] Step 300 per-step time 0.496s loss=0.383
INFO:tensorflow:Step 400 per-step time 0.520s loss=3.947
I1029 12:47:30.762565 140542339364736 model_lib_v2.py:652] Step 400 per-step time 0.520s loss=3.947
INFO:tensorflow:Step 500 per-step time 0.569s loss=3.783
I1029 12:48:23.246244 140542339364736 model_lib_v2.py:652] Step 500 per-step time 0.569s loss=3.783
INFO:tensorflow:Step 600 per-step time 0.544s loss=2.853
I1029 12:49:15.433576 140542339364736 model_lib_v2.py:652] Step 600 per-step time 0.544s loss=2.853
INFO:tensorflow:Step 700 per-step time 0.559s loss=3.217
I1029 12:50:07.139169 140542339364736 model_lib_v2.py:652] Step 700 per-step time 0.559s loss=3.217
INFO:tensorflow:Step 800 per-step time 0.503s loss=2.158
I1029 12:50:59.137556 140542339364736 model_lib_v2.py:652] Step 800 per-step time 0.503s loss=2.158
INFO:tensorflow:Step 900 per-step time 0.505s loss=1.279
I1029 12:51:50.729127 140542339364736 model_lib_v2.py:652] Step 900 per-step time 0.505s loss=1.279
INFO:tensorflow:Step 1000 per-step time 0.510s loss=2.586
I1029 12:52:42.783134 140542339364736 model_lib_v2.py:652] Step 1000 per-step time 0.510s loss=2.586
INFO:tensorflow:Step 1100 per-step time 0.528s loss=1.310
I1029 12:53:38.780284 140542339364736 model_lib_v2.py:652] Step 1100 per-step time 0.528s loss=1.310
INFO:tensorflow:Step 1200 per-step time 0.540s loss=1.572
I1029 12:54:31.082082 140542339364736 model_lib_v2.py:652] Step 1200 per-step time 0.540s loss=1.572
INFO:tensorflow:Step 1300 per-step time 0.546s loss=2.005
I1029 12:55:22.976497 140542339364736 model_lib_v2.py:652] Step 1300 per-step time 0.546s loss=2.005
INFO:tensorflow:Step 1400 per-step time 0.567s loss=1.777
I1029 12:56:15.416352 140542339364736 model_lib_v2.py:652] Step 1400 per-step time 0.567s loss=1.777
INFO:tensorflow:Step 1500 per-step time 0.506s loss=1.632
I1029 12:57:08.016613 140542339364736 model_lib_v2.py:652] Step 1500 per-step time 0.506s loss=1.632
INFO:tensorflow:Step 1600 per-step time 0.518s loss=1.746
I1029 12:57:59.979974 140542339364736 model_lib_v2.py:652] Step 1600 per-step time 0.518s loss=1.746
INFO:tensorflow:Step 1700 per-step time 0.480s loss=1.107
I1029 12:58:52.406225 140542339364736 model_lib_v2.py:652] Step 1700 per-step time 0.480s loss=1.107
INFO:tensorflow:Step 1800 per-step time 0.533s loss=1.256
I1029 12:59:44.501045 140542339364736 model_lib_v2.py:652] Step 1800 per-step time 0.533s loss=1.256
INFO:tensorflow:Step 1900 per-step time 0.521s loss=4.278
I1029 13:00:36.729074 140542339364736 model_lib_v2.py:652] Step 1900 per-step time 0.521s loss=4.278
INFO:tensorflow:Step 2000 per-step time 0.558s loss=1.917
I1029 13:01:29.490435 140542339364736 model_lib_v2.py:652] Step 2000 per-step time 0.558s loss=1.917
INFO:tensorflow:Step 2100 per-step time 0.568s loss=1.306
I1029 13:02:24.816400 140542339364736 model_lib_v2.py:652] Step 2100 per-step time 0.568s loss=1.306
INFO:tensorflow:Step 2200 per-step time 0.536s loss=1.814
I1029 13:03:17.117503 140542339364736 model_lib_v2.py:652] Step 2200 per-step time 0.536s loss=1.814
INFO:tensorflow:Step 2300 per-step time 0.530s loss=1.281
I1029 13:04:09.441817 140542339364736 model_lib_v2.py:652] Step 2300 per-step time 0.530s loss=1.281
INFO:tensorflow:Step 2400 per-step time 0.498s loss=1.792
I1029 13:05:02.058048 140542339364736 model_lib_v2.py:652] Step 2400 per-step time 0.498s loss=1.792
INFO:tensorflow:Step 2500 per-step time 0.563s loss=1.027
I1029 13:05:54.327656 140542339364736 model_lib_v2.py:652] Step 2500 per-step time 0.563s loss=1.027
INFO:tensorflow:Step 2600 per-step time 0.508s loss=1.118
I1029 13:06:46.549894 140542339364736 model_lib_v2.py:652] Step 2600 per-step time 0.508s loss=1.118
INFO:tensorflow:Step 2700 per-step time 0.565s loss=0.934
I1029 13:07:38.209280 140542339364736 model_lib_v2.py:652] Step 2700 per-step time 0.565s loss=0.934
INFO:tensorflow:Step 2800 per-step time 0.517s loss=1.405
I1029 13:08:29.393217 140542339364736 model_lib_v2.py:652] Step 2800 per-step time 0.517s loss=1.405
INFO:tensorflow:Step 2900 per-step time 0.516s loss=2.066
I1029 13:09:21.199615 140542339364736 model_lib_v2.py:652] Step 2900 per-step time 0.516s loss=2.066
INFO:tensorflow:Step 3000 per-step time 0.489s loss=1.104
I1029 13:10:13.507535 140542339364736 model_lib_v2.py:652] Step 3000 per-step time 0.489s loss=1.104
INFO:tensorflow:Step 3100 per-step time 0.502s loss=1.306
I1029 13:11:08.852216 140542339364736 model_lib_v2.py:652] Step 3100 per-step time 0.502s loss=1.306
INFO:tensorflow:Step 3200 per-step time 0.493s loss=1.892
I1029 13:12:01.301999 140542339364736 model_lib_v2.py:652] Step 3200 per-step time 0.493s loss=1.892
INFO:tensorflow:Step 3300 per-step time 0.513s loss=1.359
I1029 13:12:53.432926 140542339364736 model_lib_v2.py:652] Step 3300 per-step time 0.513s loss=1.359
INFO:tensorflow:Step 3400 per-step time 0.557s loss=2.291
I1029 13:13:46.335700 140542339364736 model_lib_v2.py:652] Step 3400 per-step time 0.557s loss=2.291
INFO:tensorflow:Step 3500 per-step time 0.536s loss=1.762
I1029 13:14:39.090899 140542339364736 model_lib_v2.py:652] Step 3500 per-step time 0.536s loss=1.762
INFO:tensorflow:Step 3600 per-step time 0.493s loss=1.875
I1029 13:15:31.147808 140542339364736 model_lib_v2.py:652] Step 3600 per-step time 0.493s loss=1.875
INFO:tensorflow:Step 3700 per-step time 0.533s loss=1.316
I1029 13:16:23.160096 140542339364736 model_lib_v2.py:652] Step 3700 per-step time 0.533s loss=1.316
INFO:tensorflow:Step 3800 per-step time 0.497s loss=1.218
I1029 13:17:15.257890 140542339364736 model_lib_v2.py:652] Step 3800 per-step time 0.497s loss=1.218
INFO:tensorflow:Step 3900 per-step time 0.517s loss=2.180
I1029 13:18:06.596120 140542339364736 model_lib_v2.py:652] Step 3900 per-step time 0.517s loss=2.180
INFO:tensorflow:Step 4000 per-step time 0.497s loss=2.539
I1029 13:18:58.014588 140542339364736 model_lib_v2.py:652] Step 4000 per-step time 0.497s loss=2.539
INFO:tensorflow:Step 4100 per-step time 0.508s loss=1.068
I1029 13:19:53.633509 140542339364736 model_lib_v2.py:652] Step 4100 per-step time 0.508s loss=1.068
INFO:tensorflow:Step 4200 per-step time 0.498s loss=1.122
I1029 13:20:45.101189 140542339364736 model_lib_v2.py:652] Step 4200 per-step time 0.498s loss=1.122
INFO:tensorflow:Step 4300 per-step time 0.516s loss=1.084
I1029 13:21:36.267271 140542339364736 model_lib_v2.py:652] Step 4300 per-step time 0.516s loss=1.084
INFO:tensorflow:Step 4400 per-step time 0.537s loss=1.096
I1029 13:22:27.746332 140542339364736 model_lib_v2.py:652] Step 4400 per-step time 0.537s loss=1.096
INFO:tensorflow:Step 4500 per-step time 0.484s loss=1.067
I1029 13:23:18.632253 140542339364736 model_lib_v2.py:652] Step 4500 per-step time 0.484s loss=1.067
INFO:tensorflow:Step 4600 per-step time 0.500s loss=0.852
I1029 13:24:10.243774 140542339364736 model_lib_v2.py:652] Step 4600 per-step time 0.500s loss=0.852
INFO:tensorflow:Step 4700 per-step time 0.537s loss=1.631
I1029 13:25:01.151782 140542339364736 model_lib_v2.py:652] Step 4700 per-step time 0.537s loss=1.631
INFO:tensorflow:Step 4800 per-step time 0.512s loss=1.865
I1029 13:25:52.482257 140542339364736 model_lib_v2.py:652] Step 4800 per-step time 0.512s loss=1.865
INFO:tensorflow:Step 4900 per-step time 0.494s loss=1.321
I1029 13:26:43.429531 140542339364736 model_lib_v2.py:652] Step 4900 per-step time 0.494s loss=1.321
INFO:tensorflow:Step 5000 per-step time 0.533s loss=0.954
I1029 13:27:34.521097 140542339364736 model_lib_v2.py:652] Step 5000 per-step time 0.533s loss=0.954
INFO:tensorflow:Step 5100 per-step time 0.512s loss=2.073
I1029 13:28:28.577929 140542339364736 model_lib_v2.py:652] Step 5100 per-step time 0.512s loss=2.073
INFO:tensorflow:Step 5200 per-step time 0.510s loss=1.776
I1029 13:29:19.974954 140542339364736 model_lib_v2.py:652] Step 5200 per-step time 0.510s loss=1.776
INFO:tensorflow:Step 5300 per-step time 0.498s loss=1.665
I1029 13:30:10.906526 140542339364736 model_lib_v2.py:652] Step 5300 per-step time 0.498s loss=1.665
INFO:tensorflow:Step 5400 per-step time 0.558s loss=1.703
I1029 13:31:01.664812 140542339364736 model_lib_v2.py:652] Step 5400 per-step time 0.558s loss=1.703
INFO:tensorflow:Step 5500 per-step time 0.549s loss=1.354
I1029 13:31:52.791409 140542339364736 model_lib_v2.py:652] Step 5500 per-step time 0.549s loss=1.354
INFO:tensorflow:Step 5600 per-step time 0.522s loss=2.461
I1029 13:32:43.751406 140542339364736 model_lib_v2.py:652] Step 5600 per-step time 0.522s loss=2.461
INFO:tensorflow:Step 5700 per-step time 0.507s loss=0.965
I1029 13:33:34.303392 140542339364736 model_lib_v2.py:652] Step 5700 per-step time 0.507s loss=0.965
INFO:tensorflow:Step 5800 per-step time 0.529s loss=3.884
I1029 13:34:25.405073 140542339364736 model_lib_v2.py:652] Step 5800 per-step time 0.529s loss=3.884
INFO:tensorflow:Step 5900 per-step time 0.556s loss=4.054
I1029 13:35:16.604737 140542339364736 model_lib_v2.py:652] Step 5900 per-step time 0.556s loss=4.054
INFO:tensorflow:Step 6000 per-step time 0.498s loss=1.274
I1029 13:36:06.901327 140542339364736 model_lib_v2.py:652] Step 6000 per-step time 0.498s loss=1.274
INFO:tensorflow:Step 6100 per-step time 0.474s loss=5.113
I1029 13:37:01.013803 140542339364736 model_lib_v2.py:652] Step 6100 per-step time 0.474s loss=5.113
INFO:tensorflow:Step 6200 per-step time 0.512s loss=1.600
I1029 13:37:51.701743 140542339364736 model_lib_v2.py:652] Step 6200 per-step time 0.512s loss=1.600
INFO:tensorflow:Step 6300 per-step time 0.489s loss=1.340
I1029 13:38:42.389535 140542339364736 model_lib_v2.py:652] Step 6300 per-step time 0.489s loss=1.340
INFO:tensorflow:Step 6400 per-step time 0.485s loss=1.633
I1029 13:39:33.416359 140542339364736 model_lib_v2.py:652] Step 6400 per-step time 0.485s loss=1.633
INFO:tensorflow:Step 6500 per-step time 0.557s loss=0.893
I1029 13:40:24.813894 140542339364736 model_lib_v2.py:652] Step 6500 per-step time 0.557s loss=0.893
INFO:tensorflow:Step 6600 per-step time 0.487s loss=2.567
I1029 13:41:15.736062 140542339364736 model_lib_v2.py:652] Step 6600 per-step time 0.487s loss=2.567
INFO:tensorflow:Step 6700 per-step time 0.524s loss=1.123
I1029 13:42:07.044886 140542339364736 model_lib_v2.py:652] Step 6700 per-step time 0.524s loss=1.123
INFO:tensorflow:Step 6800 per-step time 0.481s loss=1.252
I1029 13:42:57.627677 140542339364736 model_lib_v2.py:652] Step 6800 per-step time 0.481s loss=1.252
INFO:tensorflow:Step 6900 per-step time 0.523s loss=1.807
I1029 13:43:48.721600 140542339364736 model_lib_v2.py:652] Step 6900 per-step time 0.523s loss=1.807
INFO:tensorflow:Step 7000 per-step time 0.472s loss=1.350
I1029 13:44:39.643476 140542339364736 model_lib_v2.py:652] Step 7000 per-step time 0.472s loss=1.350
INFO:tensorflow:Step 7100 per-step time 0.492s loss=1.081
I1029 13:45:34.134005 140542339364736 model_lib_v2.py:652] Step 7100 per-step time 0.492s loss=1.081
INFO:tensorflow:Step 7200 per-step time 0.549s loss=0.827
I1029 13:46:25.087576 140542339364736 model_lib_v2.py:652] Step 7200 per-step time 0.549s loss=0.827
INFO:tensorflow:Step 7300 per-step time 0.484s loss=1.092
I1029 13:47:15.917082 140542339364736 model_lib_v2.py:652] Step 7300 per-step time 0.484s loss=1.092
INFO:tensorflow:Step 7400 per-step time 0.481s loss=10.411
I1029 13:48:06.368654 140542339364736 model_lib_v2.py:652] Step 7400 per-step time 0.481s loss=10.411
INFO:tensorflow:Step 7500 per-step time 0.517s loss=1.383
I1029 13:48:57.384352 140542339364736 model_lib_v2.py:652] Step 7500 per-step time 0.517s loss=1.383
INFO:tensorflow:Step 7600 per-step time 0.562s loss=3.070
I1029 13:49:48.132217 140542339364736 model_lib_v2.py:652] Step 7600 per-step time 0.562s loss=3.070
INFO:tensorflow:Step 7700 per-step time 0.523s loss=3.792
I1029 13:50:38.746967 140542339364736 model_lib_v2.py:652] Step 7700 per-step time 0.523s loss=3.792
INFO:tensorflow:Step 7800 per-step time 0.527s loss=1.392
I1029 13:51:29.670202 140542339364736 model_lib_v2.py:652] Step 7800 per-step time 0.527s loss=1.392
INFO:tensorflow:Step 7900 per-step time 0.528s loss=2.461
I1029 13:52:20.082690 140542339364736 model_lib_v2.py:652] Step 7900 per-step time 0.528s loss=2.461
INFO:tensorflow:Step 8000 per-step time 0.513s loss=0.943
I1029 13:53:10.604577 140542339364736 model_lib_v2.py:652] Step 8000 per-step time 0.513s loss=0.943
INFO:tensorflow:Step 8100 per-step time 0.450s loss=0.813
I1029 13:54:04.975039 140542339364736 model_lib_v2.py:652] Step 8100 per-step time 0.450s loss=0.813
INFO:tensorflow:Step 8200 per-step time 0.513s loss=2.298
I1029 13:54:55.844736 140542339364736 model_lib_v2.py:652] Step 8200 per-step time 0.513s loss=2.298
INFO:tensorflow:Step 8300 per-step time 0.450s loss=0.836
I1029 13:55:46.491264 140542339364736 model_lib_v2.py:652] Step 8300 per-step time 0.450s loss=0.836
INFO:tensorflow:Step 8400 per-step time 0.497s loss=1.729
I1029 13:56:36.891902 140542339364736 model_lib_v2.py:652] Step 8400 per-step time 0.497s loss=1.729
INFO:tensorflow:Step 8500 per-step time 0.528s loss=1.303
I1029 13:57:27.694581 140542339364736 model_lib_v2.py:652] Step 8500 per-step time 0.528s loss=1.303
INFO:tensorflow:Step 8600 per-step time 0.562s loss=0.801
I1029 13:58:17.776222 140542339364736 model_lib_v2.py:652] Step 8600 per-step time 0.562s loss=0.801
INFO:tensorflow:Step 8700 per-step time 0.492s loss=2.019
I1029 13:59:07.951687 140542339364736 model_lib_v2.py:652] Step 8700 per-step time 0.492s loss=2.019
INFO:tensorflow:Step 8800 per-step time 0.486s loss=0.862
I1029 13:59:58.334410 140542339364736 model_lib_v2.py:652] Step 8800 per-step time 0.486s loss=0.862
INFO:tensorflow:Step 8900 per-step time 0.493s loss=0.690
I1029 14:00:48.527296 140542339364736 model_lib_v2.py:652] Step 8900 per-step time 0.493s loss=0.690
INFO:tensorflow:Step 9000 per-step time 0.490s loss=0.833
I1029 14:01:38.955377 140542339364736 model_lib_v2.py:652] Step 9000 per-step time 0.490s loss=0.833
INFO:tensorflow:Step 9100 per-step time 0.490s loss=1.173
I1029 14:02:34.241779 140542339364736 model_lib_v2.py:652] Step 9100 per-step time 0.490s loss=1.173
INFO:tensorflow:Step 9200 per-step time 0.501s loss=1.211
I1029 14:03:24.799855 140542339364736 model_lib_v2.py:652] Step 9200 per-step time 0.501s loss=1.211
INFO:tensorflow:Step 9300 per-step time 0.510s loss=1.001
I1029 14:04:15.496420 140542339364736 model_lib_v2.py:652] Step 9300 per-step time 0.510s loss=1.001
INFO:tensorflow:Step 9400 per-step time 0.498s loss=1.144
I1029 14:05:05.908321 140542339364736 model_lib_v2.py:652] Step 9400 per-step time 0.498s loss=1.144
INFO:tensorflow:Step 9500 per-step time 0.479s loss=1.051
I1029 14:05:56.084955 140542339364736 model_lib_v2.py:652] Step 9500 per-step time 0.479s loss=1.051
INFO:tensorflow:Step 9600 per-step time 0.525s loss=1.345
I1029 14:06:46.489283 140542339364736 model_lib_v2.py:652] Step 9600 per-step time 0.525s loss=1.345
INFO:tensorflow:Step 9700 per-step time 0.557s loss=0.874
I1029 14:07:37.305750 140542339364736 model_lib_v2.py:652] Step 9700 per-step time 0.557s loss=0.874
INFO:tensorflow:Step 9800 per-step time 0.485s loss=1.220
I1029 14:08:27.431810 140542339364736 model_lib_v2.py:652] Step 9800 per-step time 0.485s loss=1.220
INFO:tensorflow:Step 9900 per-step time 0.503s loss=0.936
I1029 14:09:17.496555 140542339364736 model_lib_v2.py:652] Step 9900 per-step time 0.503s loss=0.936
INFO:tensorflow:Step 10000 per-step time 0.508s loss=1.677
I1029 14:10:08.573937 140542339364736 model_lib_v2.py:652] Step 10000 per-step time 0.508s loss=1.677
INFO:tensorflow:Step 10100 per-step time 0.507s loss=0.721
I1029 14:11:02.017778 140542339364736 model_lib_v2.py:652] Step 10100 per-step time 0.507s loss=0.721
INFO:tensorflow:Step 10200 per-step time 0.501s loss=1.087
I1029 14:11:52.718534 140542339364736 model_lib_v2.py:652] Step 10200 per-step time 0.501s loss=1.087
INFO:tensorflow:Step 10300 per-step time 0.515s loss=0.976
I1029 14:12:43.202686 140542339364736 model_lib_v2.py:652] Step 10300 per-step time 0.515s loss=0.976
INFO:tensorflow:Step 10400 per-step time 0.490s loss=2.031
I1029 14:13:34.101810 140542339364736 model_lib_v2.py:652] Step 10400 per-step time 0.490s loss=2.031
INFO:tensorflow:Step 10500 per-step time 0.478s loss=0.713
I1029 14:14:24.539195 140542339364736 model_lib_v2.py:652] Step 10500 per-step time 0.478s loss=0.713
INFO:tensorflow:Step 10600 per-step time 0.475s loss=0.615
I1029 14:15:15.026510 140542339364736 model_lib_v2.py:652] Step 10600 per-step time 0.475s loss=0.615
INFO:tensorflow:Step 10700 per-step time 0.530s loss=1.473
I1029 14:16:04.971020 140542339364736 model_lib_v2.py:652] Step 10700 per-step time 0.530s loss=1.473
INFO:tensorflow:Step 10800 per-step time 0.471s loss=0.766
I1029 14:16:55.189934 140542339364736 model_lib_v2.py:652] Step 10800 per-step time 0.471s loss=0.766
INFO:tensorflow:Step 10900 per-step time 0.470s loss=0.756
I1029 14:17:45.739089 140542339364736 model_lib_v2.py:652] Step 10900 per-step time 0.470s loss=0.756
INFO:tensorflow:Step 11000 per-step time 0.513s loss=0.672
I1029 14:18:36.013757 140542339364736 model_lib_v2.py:652] Step 11000 per-step time 0.513s loss=0.672
INFO:tensorflow:Step 11100 per-step time 0.534s loss=1.322
I1029 14:19:30.549791 140542339364736 model_lib_v2.py:652] Step 11100 per-step time 0.534s loss=1.322
INFO:tensorflow:Step 11200 per-step time 0.493s loss=2.536
I1029 14:20:20.629245 140542339364736 model_lib_v2.py:652] Step 11200 per-step time 0.493s loss=2.536
INFO:tensorflow:Step 11300 per-step time 0.513s loss=0.896
I1029 14:21:10.903007 140542339364736 model_lib_v2.py:652] Step 11300 per-step time 0.513s loss=0.896
INFO:tensorflow:Step 11400 per-step time 0.516s loss=0.846
I1029 14:22:01.414907 140542339364736 model_lib_v2.py:652] Step 11400 per-step time 0.516s loss=0.846
INFO:tensorflow:Step 11500 per-step time 0.499s loss=0.677
I1029 14:22:51.766870 140542339364736 model_lib_v2.py:652] Step 11500 per-step time 0.499s loss=0.677
INFO:tensorflow:Step 11600 per-step time 0.496s loss=0.964
I1029 14:23:42.223812 140542339364736 model_lib_v2.py:652] Step 11600 per-step time 0.496s loss=0.964
INFO:tensorflow:Step 11700 per-step time 0.514s loss=0.753
I1029 14:24:33.537962 140542339364736 model_lib_v2.py:652] Step 11700 per-step time 0.514s loss=0.753
INFO:tensorflow:Step 11800 per-step time 0.522s loss=1.038
I1029 14:25:24.200989 140542339364736 model_lib_v2.py:652] Step 11800 per-step time 0.522s loss=1.038
INFO:tensorflow:Step 11900 per-step time 0.515s loss=1.071
I1029 14:26:14.838154 140542339364736 model_lib_v2.py:652] Step 11900 per-step time 0.515s loss=1.071
INFO:tensorflow:Step 12000 per-step time 0.495s loss=1.208
I1029 14:27:05.196205 140542339364736 model_lib_v2.py:652] Step 12000 per-step time 0.495s loss=1.208
INFO:tensorflow:Step 12100 per-step time 0.452s loss=0.634
I1029 14:27:58.433426 140542339364736 model_lib_v2.py:652] Step 12100 per-step time 0.452s loss=0.634
INFO:tensorflow:Step 12200 per-step time 0.503s loss=0.833
I1029 14:28:48.560185 140542339364736 model_lib_v2.py:652] Step 12200 per-step time 0.503s loss=0.833
INFO:tensorflow:Step 12300 per-step time 0.479s loss=0.595
I1029 14:29:39.150941 140542339364736 model_lib_v2.py:652] Step 12300 per-step time 0.479s loss=0.595
INFO:tensorflow:Step 12400 per-step time 0.533s loss=0.593
I1029 14:30:29.566613 140542339364736 model_lib_v2.py:652] Step 12400 per-step time 0.533s loss=0.593
INFO:tensorflow:Step 12500 per-step time 0.498s loss=0.822
I1029 14:31:20.123387 140542339364736 model_lib_v2.py:652] Step 12500 per-step time 0.498s loss=0.822
INFO:tensorflow:Step 12600 per-step time 0.516s loss=1.123
I1029 14:32:10.598557 140542339364736 model_lib_v2.py:652] Step 12600 per-step time 0.516s loss=1.123
INFO:tensorflow:Step 12700 per-step time 0.485s loss=0.656
I1029 14:33:01.189325 140542339364736 model_lib_v2.py:652] Step 12700 per-step time 0.485s loss=0.656
INFO:tensorflow:Step 12800 per-step time 0.560s loss=0.920
I1029 14:33:51.198982 140542339364736 model_lib_v2.py:652] Step 12800 per-step time 0.560s loss=0.920
INFO:tensorflow:Step 12900 per-step time 0.490s loss=0.594
I1029 14:34:41.759110 140542339364736 model_lib_v2.py:652] Step 12900 per-step time 0.490s loss=0.594
INFO:tensorflow:Step 13000 per-step time 0.524s loss=0.676
I1029 14:35:32.287856 140542339364736 model_lib_v2.py:652] Step 13000 per-step time 0.524s loss=0.676
INFO:tensorflow:Step 13100 per-step time 0.501s loss=1.043
I1029 14:36:26.606545 140542339364736 model_lib_v2.py:652] Step 13100 per-step time 0.501s loss=1.043
INFO:tensorflow:Step 13200 per-step time 0.515s loss=1.266
I1029 14:37:17.995649 140542339364736 model_lib_v2.py:652] Step 13200 per-step time 0.515s loss=1.266
INFO:tensorflow:Step 13300 per-step time 0.508s loss=0.412
I1029 14:38:09.160014 140542339364736 model_lib_v2.py:652] Step 13300 per-step time 0.508s loss=0.412
INFO:tensorflow:Step 13400 per-step time 0.522s loss=0.569
I1029 14:39:00.557772 140542339364736 model_lib_v2.py:652] Step 13400 per-step time 0.522s loss=0.569
INFO:tensorflow:Step 13500 per-step time 0.524s loss=0.887
I1029 14:39:51.596146 140542339364736 model_lib_v2.py:652] Step 13500 per-step time 0.524s loss=0.887
INFO:tensorflow:Step 13600 per-step time 0.543s loss=0.579
I1029 14:40:42.914199 140542339364736 model_lib_v2.py:652] Step 13600 per-step time 0.543s loss=0.579
INFO:tensorflow:Step 13700 per-step time 0.643s loss=0.878
I1029 14:41:34.550312 140542339364736 model_lib_v2.py:652] Step 13700 per-step time 0.643s loss=0.878
INFO:tensorflow:Step 13800 per-step time 0.510s loss=0.570
I1029 14:42:25.519177 140542339364736 model_lib_v2.py:652] Step 13800 per-step time 0.510s loss=0.570
INFO:tensorflow:Step 13900 per-step time 0.542s loss=1.741
I1029 14:43:17.112121 140542339364736 model_lib_v2.py:652] Step 13900 per-step time 0.542s loss=1.741
INFO:tensorflow:Step 14000 per-step time 0.516s loss=0.849
I1029 14:44:08.560875 140542339364736 model_lib_v2.py:652] Step 14000 per-step time 0.516s loss=0.849
INFO:tensorflow:Step 14100 per-step time 0.526s loss=0.826
I1029 14:45:03.613667 140542339364736 model_lib_v2.py:652] Step 14100 per-step time 0.526s loss=0.8
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.