ageron / ageron/handson-ml2

Chapter 19 : Training and Deploying TF Models at scale

Open
#205 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
30k
Forks
13.1k
PR merge metrics
No merged PRs in 30d

Description

Hello, I successfully reproduced the process described in "Using the Prediction Service" p682-683 of the book with the toy model "my_mnist_model' (turns the trained model into a serverless cloud model). However, when it failed when I tried with a more evolved model (a Mask-RCNN running on 1600*1900 images), because the json format is not adapted to images ("Rest Json call not working : Request payload size exceeds the limit: 1572864 bytes.")

I'm trying to switch to gRPC, but it seems that the Google API doesn't provide an easy way to do this. If I'm wrong, could you please provide a code for the "predict(X)" function on page 684(* or in section Deploy the model to Google Cloud AI Platform of the Chapter 19 Notebook in github) that uses gRPC instead of Json to transfer the input data ?

If you have any other way to feed large images to a serverless model, I'm all ears.
Thanks for your help .

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.