aws / aws/amazon-sagemaker-examples

unable to serve tensorflow object detection trained model

Open
#1,018 8 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
11k
Forks
7k
Avg merge
8h 29m
Merged PRs (30d)
8

Description

I am trying to serve a tensorflow object detection model, trained outside . I am getting below error while deploying

2020-02-05 13:26:36.548229: E tensorflow_serving/util/retrier.cc:37] Loading servable: {name: generic_model version: 1} failed: Not found: Op type not registered 'FusedBatchNormV3' in binary running on model.aws.local. Make sure the Op and Kernel are registered in the binary running in this process. Note that if you are loading a saved graph which used ops from tf.contrib, accessing (e.g.) `tf.contrib.resampler` should be done before importing the graph, as contrib ops are lazily registered when the module is first accessed.

the apis i am using is given below
sagemaker_model = TensorFlowModel(model_data = 's3://traindatavinayak/model/model.tar.gz',
role = role,
#framework_version = '1.12',
entry_point = 'train.py')

predictor = sagemaker_model.deploy(initial_instance_count=1,
instance_type='ml.m4.xlarge')

Contributor guide

Open the contributing guide

Research direction

Start with the TensorFlowModel deployment configuration and the reported TensorFlow Serving log, then compare the trained model's TensorFlow version and ops with the SageMaker framework version shown in the API snippet. Done means the external object-detection model deploys and loads without the missing FusedBatchNormV3 operation error.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, python, tensorflow
Domain
cloud, machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.