<hr>
<h3 dir="auto">System information</h3>
<ul dir="auto">
<li><strong>Have I written custom code (as opposed to using a stock example script provided in TensorFlow)</strong>: No</li>
<li><strong>OS Platform and Distribution (e.g., Linux Ubuntu 16.04)</strong>: Linux Ubuntu 16.04</li>
<li><strong>Mobile device (e.g. iPhone 8, Pixel 2, Samsung Galaxy) if the issue happens on mobile device</strong>:No</li>
<li><strong>TensorFlow installed from (source or binary)</strong>:Binary with gpu supported</li>
<li><strong>TensorFlow version (use command below)</strong>:1.11.0</li>
<li><strong>Python version</strong>:python 27</li>
<li><strong>Bazel version (if compiling from source)</strong>:</li>
<li><strong>GCC/Compiler version (if compiling from source)</strong>:</li>
<li><strong>CUDA/cuDNN version</strong>:9.0</li>
<li><strong>GPU model and memory</strong>: ec2 p2.16xlarge 16 NVIDIA K80 GPUs</li>
<li><strong>Exact command to reproduce</strong>:</li>
</ul>
<h3 dir="auto">Describe the problem</h3>
<p dir="auto">Hi all, I already opened this issue in tensorflow-serving but I think this might be a better place to open this issue. Please let know if I need to close the previous one.<br>
I used the code below to test whether tensor-serving works with tensorflow. Here are some combinations and results:<br>
TF 1.10.0 TF-Serving 1.10.0 Success<br>
TF 1.11.0 TF-Serving 1.10.0 Failed<br>
TF 1.11.0 TF-Serving 1.11.0rc1 Failed</p>
<h3 dir="auto">Source code / logs</h3>
<div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="python tensorflow_serving/example/mnist_saved_model.py /tmp/mnist_model || exit 1

tensorflow_model_server --port=9000 --model_name=mnist --model_base_path=/tmp/mnist_model/ &amp;
SERVER_PID=$!

python mnist_client.py --num_tests=1000 --server=localhost:9000 || exit 1

kill -9 $SERVER_PID"><pre class="notranslate"><code class="notranslate">python tensorflow_serving/example/mnist_saved_model.py /tmp/mnist_model || exit 1

tensorflow_model_server --port=9000 --model_name=mnist --model_base_path=/tmp/mnist_model/ &amp;
SERVER_PID=$!

python mnist_client.py --num_tests=1000 --server=localhost:9000 || exit 1

kill -9 $SERVER_PID
</code></pre></div>
<p dir="auto">Log</p>
<div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="Training model...
Successfully downloaded train-images-idx3-ubyte.gz 9912422 bytes.
Extracting /tmp/train-images-idx3-ubyte.gz
Successfully downloaded train-labels-idx1-ubyte.gz 28881 bytes.
Extracting /tmp/train-labels-idx1-ubyte.gz
Successfully downloaded t10k-images-idx3-ubyte.gz 1648877 bytes.
Extracting /tmp/t10k-images-idx3-ubyte.gz
Successfully downloaded t10k-labels-idx1-ubyte.gz 4542 bytes.
Extracting /tmp/t10k-labels-idx1-ubyte.gz
training accuracy 0.9092
Done training!
Exporting trained model to /tmp/mnist_model/1
WARNING:tensorflow:From mnist_saved_model.py:139: calling add_meta_graph_and_variables (from tensorflow.python.saved_model.builder_impl) with legacy_init_op is deprecated and will be removed in a future version.
Instructions for updating:
Pass your op to the equivalent parameter main_op instead.
Done exporting!
Extracting /tmp/train-images-idx3-ubyte.gz
Extracting /tmp/train-labels-idx1-ubyte.gz
Extracting /tmp/t10k-images-idx3-ubyte.gz
Extracting /tmp/t10k-labels-idx1-ubyte.gz
&lt;_Rendezvous of RPC that terminated with (StatusCode.UNAVAILABLE, Connect Failed)&gt;
&lt;_Rendezvous of RPC that terminated with (StatusCode.UNAVAILABLE, Connect Failed)&gt;
&lt;_Rendezvous of RPC that terminated with (StatusCode.UNAVAILABLE, Connect Failed)&gt;
2018-10-02 21:18:32.604303: E external/org_tensorflow/tensorflow/core/common_runtime/executor.cc:697] Executor failed to create kernel. Invalid argument: NodeDef mentions attr 'Truncate' not in Op&lt;name=Cast; signature=x:SrcT -&gt; y:DstT; attr=SrcT:type; attr=DstT:type&gt;; NodeDef: index_to_string/ToInt64 = Cast[DstT=DT_INT64, SrcT=DT_INT32, Truncate=false, _output_shapes=[[10]], _device=&quot;/job:localhost/replica:0/task:0/device:CPU:0&quot;](index_to_string/range). (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
	 [[Node: index_to_string/ToInt64 = Cast[DstT=DT_INT64, SrcT=DT_INT32, Truncate=false, _output_shapes=[[10]], _device=&quot;/job:localhost/replica:0/task:0/device:CPU:0&quot;](index_to_string/range)]]
2018-10-02 21:18:32.604833: E external/org_tensorflow/tensorflow/core/common_runtime/executor.cc:697] Executor failed to create kernel. Invalid argument: NodeDef mentions attr 'Truncate' not in Op&lt;name=Cast; signature=x:SrcT -&gt; y:DstT; attr=SrcT:type; attr=DstT:type&gt;; NodeDef: index_to_string/ToInt64 = Cast[DstT=DT_INT64, SrcT=DT_INT32, Truncate=false, _output_shapes=[[10]], _device=&quot;/job:localhost/replica:0/task:0/device:CPU:0&quot;](index_to_string/range). (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
	 [[Node: index_to_string/ToInt64 = Cast[DstT=DT_INT64, SrcT=DT_INT32, Truncate=false, _output_shapes=[[10]], _device=&quot;/job:localhost/replica:0/task:0/device:CPU:0&quot;](index_to_string/range)]]
2018-10-02 21:18:32.604980: E tensorflow_serving/util/retrier.cc:37] Loading servable: {name: mnist version: 1} failed: Invalid argument: NodeDef mentions attr 'Truncate' not in Op&lt;name=Cast; signature=x:SrcT -&gt; y:DstT; attr=SrcT:type; attr=DstT:type&gt;; NodeDef: index_to_string/ToInt64 = Cast[DstT=DT_INT64, SrcT=DT_INT32, Truncate=false, _output_shapes=[[10]], _device=&quot;/job:localhost/replica:0/task:0/device:CPU:0&quot;](index_to_string/range). (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
	 [[Node: index_to_string/ToInt64 = Cast[DstT=DT_INT64, SrcT=DT_INT32, Truncate=false, _output_shapes=[[10]], _device=&quot;/job:localhost/replica:0/task:0/device:CPU:0&quot;](index_to_string/range)]]
&lt;_Rendezvous of RPC that terminated with (StatusCode.UNAVAILABLE, Connect Failed)&gt;
&lt;_Rendezvous of RPC that terminated with (StatusCode.UNAVAILABLE, Connect Failed)&gt;
&lt;_Rendezvous of RPC that terminated with (StatusCode.DEADLINE_EXCEEDED, Deadline Exceeded)&gt;
&lt;_Rendezvous of RPC that terminated with (StatusCode.UNAVAILABLE, Connect Failed)&gt;
&lt;_Rendezvous of RPC that terminated with (StatusCode.DEADLINE_EXCEEDED, Deadline Exceeded)&gt;
&lt;_Rendezvous of RPC that terminated with (StatusCode.UNAVAILABLE, Connect Failed)&gt;
&lt;_Rendezvous of RPC that terminated with (StatusCode.DEADLINE_EXCEEDED, Deadline Exceeded)&gt;
&lt;_Rendezvous of RPC that terminated with (StatusCode.DEADLINE_EXCEEDED, Deadline Exceeded)&gt;
&lt;_Rendezvous of RPC that terminated with (StatusCode.DEADLINE_EXCEEDED, Deadline Exceeded)&gt;
&lt;_Rendezvous of RPC that terminated with (StatusCode.UNAVAILABLE, Connect Failed)&gt;"><pre class="notranslate"><code class="notranslate">Training model...
Successfully downloaded train-images-idx3-ubyte.gz 9912422 bytes.
Extracting /tmp/train-images-idx3-ubyte.gz
Successfully downloaded train-labels-idx1-ubyte.gz 28881 bytes.
Extracting /tmp/train-labels-idx1-ubyte.gz
Successfully downloaded t10k-images-idx3-ubyte.gz 1648877 bytes.
Extracting /tmp/t10k-images-idx3-ubyte.gz
Successfully downloaded t10k-labels-idx1-ubyte.gz 4542 bytes.
Extracting /tmp/t10k-labels-idx1-ubyte.gz
training accuracy 0.9092
Done training!
Exporting trained model to /tmp/mnist_model/1
WARNING:tensorflow:From mnist_saved_model.py:139: calling add_meta_graph_and_variables (from tensorflow.python.saved_model.builder_impl) with legacy_init_op is deprecated and will be removed in a future version.
Instructions for updating:
Pass your op to the equivalent parameter main_op instead.
Done exporting!
Extracting /tmp/train-images-idx3-ubyte.gz
Extracting /tmp/train-labels-idx1-ubyte.gz
Extracting /tmp/t10k-images-idx3-ubyte.gz
Extracting /tmp/t10k-labels-idx1-ubyte.gz
&lt;_Rendezvous of RPC that terminated with (StatusCode.UNAVAILABLE, Connect Failed)&gt;
&lt;_Rendezvous of RPC that terminated with (StatusCode.UNAVAILABLE, Connect Failed)&gt;
&lt;_Rendezvous of RPC that terminated with (StatusCode.UNAVAILABLE, Connect Failed)&gt;
2018-10-02 21:18:32.604303: E external/org_tensorflow/tensorflow/core/common_runtime/executor.cc:697] Executor failed to create kernel. Invalid argument: NodeDef mentions attr 'Truncate' not in Op&lt;name=Cast; signature=x:SrcT -&gt; y:DstT; attr=SrcT:type; attr=DstT:type&gt;; NodeDef: index_to_string/ToInt64 = Cast[DstT=DT_INT64, SrcT=DT_INT32, Truncate=false, _output_shapes=[[10]], _device="/job:localhost/replica:0/task:0/device:CPU:0"](index_to_string/range). (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
	 [[Node: index_to_string/ToInt64 = Cast[DstT=DT_INT64, SrcT=DT_INT32, Truncate=false, _output_shapes=[[10]], _device="/job:localhost/replica:0/task:0/device:CPU:0"](index_to_string/range)]]
2018-10-02 21:18:32.604833: E external/org_tensorflow/tensorflow/core/common_runtime/executor.cc:697] Executor failed to create kernel. Invalid argument: NodeDef mentions attr 'Truncate' not in Op&lt;name=Cast; signature=x:SrcT -&gt; y:DstT; attr=SrcT:type; attr=DstT:type&gt;; NodeDef: index_to_string/ToInt64 = Cast[DstT=DT_INT64, SrcT=DT_INT32, Truncate=false, _output_shapes=[[10]], _device="/job:localhost/replica:0/task:0/device:CPU:0"](index_to_string/range). (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
	 [[Node: index_to_string/ToInt64 = Cast[DstT=DT_INT64, SrcT=DT_INT32, Truncate=false, _output_shapes=[[10]], _device="/job:localhost/replica:0/task:0/device:CPU:0"](index_to_string/range)]]
2018-10-02 21:18:32.604980: E tensorflow_serving/util/retrier.cc:37] Loading servable: {name: mnist version: 1} failed: Invalid argument: NodeDef mentions attr 'Truncate' not in Op&lt;name=Cast; signature=x:SrcT -&gt; y:DstT; attr=SrcT:type; attr=DstT:type&gt;; NodeDef: index_to_string/ToInt64 = Cast[DstT=DT_INT64, SrcT=DT_INT32, Truncate=false, _output_shapes=[[10]], _device="/job:localhost/replica:0/task:0/device:CPU:0"](index_to_string/range). (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
	 [[Node: index_to_string/ToInt64 = Cast[DstT=DT_INT64, SrcT=DT_INT32, Truncate=false, _output_shapes=[[10]], _device="/job:localhost/replica:0/task:0/device:CPU:0"](index_to_string/range)]]
&lt;_Rendezvous of RPC that terminated with (StatusCode.UNAVAILABLE, Connect Failed)&gt;
&lt;_Rendezvous of RPC that terminated with (StatusCode.UNAVAILABLE, Connect Failed)&gt;
&lt;_Rendezvous of RPC that terminated with (StatusCode.DEADLINE_EXCEEDED, Deadline Exceeded)&gt;
&lt;_Rendezvous of RPC that terminated with (StatusCode.UNAVAILABLE, Connect Failed)&gt;
&lt;_Rendezvous of RPC that terminated with (StatusCode.DEADLINE_EXCEEDED, Deadline Exceeded)&gt;
&lt;_Rendezvous of RPC that terminated with (StatusCode.UNAVAILABLE, Connect Failed)&gt;
&lt;_Rendezvous of RPC that terminated with (StatusCode.DEADLINE_EXCEEDED, Deadline Exceeded)&gt;
&lt;_Rendezvous of RPC that terminated with (StatusCode.DEADLINE_EXCEEDED, Deadline Exceeded)&gt;
&lt;_Rendezvous of RPC that terminated with (StatusCode.DEADLINE_EXCEEDED, Deadline Exceeded)&gt;
&lt;_Rendezvous of RPC that terminated with (StatusCode.UNAVAILABLE, Connect Failed)&gt;
</code></pre></div>
<h3 dir="auto">System information</h3>
<ul dir="auto">
<li><strong>Hardware</strong>: AWS EC2 p2.16xlarge</li>
<li><strong>OS Platform and Distribution</strong>: Linux Ubuntu 16.04</li>
<li><strong>TensorFlow Serving installed from (source or binary)</strong>:<br>
pip install tensorflow-serving-api<br>
pip install tensorflow-serving-api==1.11.0rc1</li>
<li><strong>TensorFlow Serving version</strong>:<br>
both 1.10.0 and 1.11.0rc1</li>
</ul>
<h3 dir="auto">Describe the problem</h3>
<p dir="auto">I used the code below to test whether tensor-serving works with tensorflow. Here are some combinations and results:<br>
TF 1.10.0 TF-Serving 1.10.0 Success<br>
TF 1.11.0 TF-Serving 1.10.0 Failed<br>
TF 1.11.0 TF-Serving 1.11.0rc1 Failed</p>
<h3 dir="auto">Exact Steps to Reproduce</h3>
<p dir="auto">Here is the example code that I run to reproduce the problem:</p>
<div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="python mnist_saved_model.py /tmp/mnist_model || exit 1

tensorflow_model_server --port=9000 --model_name=mnist --model_base_path=/tmp/mnist_model/ &amp;
SERVER_PID=$!

python mnist_client.py --num_tests=1000 --server=localhost:9000 || exit 1

kill -9 $SERVER_PID"><pre class="notranslate"><code class="notranslate">python mnist_saved_model.py /tmp/mnist_model || exit 1

tensorflow_model_server --port=9000 --model_name=mnist --model_base_path=/tmp/mnist_model/ &amp;
SERVER_PID=$!

python mnist_client.py --num_tests=1000 --server=localhost:9000 || exit 1

kill -9 $SERVER_PID
</code></pre></div>
<h3 dir="auto">Source code / logs</h3>
<p dir="auto">For minimum code please see above reproduce section. Logs:</p>
<div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="Training model...
Successfully downloaded train-images-idx3-ubyte.gz 9912422 bytes.
Extracting /tmp/train-images-idx3-ubyte.gz
Successfully downloaded train-labels-idx1-ubyte.gz 28881 bytes.
Extracting /tmp/train-labels-idx1-ubyte.gz
Successfully downloaded t10k-images-idx3-ubyte.gz 1648877 bytes.
Extracting /tmp/t10k-images-idx3-ubyte.gz
Successfully downloaded t10k-labels-idx1-ubyte.gz 4542 bytes.
Extracting /tmp/t10k-labels-idx1-ubyte.gz
training accuracy 0.9092
Done training!
Exporting trained model to /tmp/mnist_model/1
WARNING:tensorflow:From mnist_saved_model.py:139: calling add_meta_graph_and_variables (from tensorflow.python.saved_model.builder_impl) with legacy_init_op is deprecated and will be removed in a future version.
Instructions for updating:
Pass your op to the equivalent parameter main_op instead.
Done exporting!
Extracting /tmp/train-images-idx3-ubyte.gz
Extracting /tmp/train-labels-idx1-ubyte.gz
Extracting /tmp/t10k-images-idx3-ubyte.gz
Extracting /tmp/t10k-labels-idx1-ubyte.gz
&lt;_Rendezvous of RPC that terminated with (StatusCode.UNAVAILABLE, Connect Failed)&gt;
&lt;_Rendezvous of RPC that terminated with (StatusCode.UNAVAILABLE, Connect Failed)&gt;
&lt;_Rendezvous of RPC that terminated with (StatusCode.UNAVAILABLE, Connect Failed)&gt;
2018-10-02 21:18:32.604303: E external/org_tensorflow/tensorflow/core/common_runtime/executor.cc:697] Executor failed to create kernel. Invalid argument: NodeDef mentions attr 'Truncate' not in Op&lt;name=Cast; signature=x:SrcT -&gt; y:DstT; attr=SrcT:type; attr=DstT:type&gt;; NodeDef: index_to_string/ToInt64 = Cast[DstT=DT_INT64, SrcT=DT_INT32, Truncate=false, _output_shapes=[[10]], _device=&quot;/job:localhost/replica:0/task:0/device:CPU:0&quot;](index_to_string/range). (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
	 [[Node: index_to_string/ToInt64 = Cast[DstT=DT_INT64, SrcT=DT_INT32, Truncate=false, _output_shapes=[[10]], _device=&quot;/job:localhost/replica:0/task:0/device:CPU:0&quot;](index_to_string/range)]]
2018-10-02 21:18:32.604833: E external/org_tensorflow/tensorflow/core/common_runtime/executor.cc:697] Executor failed to create kernel. Invalid argument: NodeDef mentions attr 'Truncate' not in Op&lt;name=Cast; signature=x:SrcT -&gt; y:DstT; attr=SrcT:type; attr=DstT:type&gt;; NodeDef: index_to_string/ToInt64 = Cast[DstT=DT_INT64, SrcT=DT_INT32, Truncate=false, _output_shapes=[[10]], _device=&quot;/job:localhost/replica:0/task:0/device:CPU:0&quot;](index_to_string/range). (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
	 [[Node: index_to_string/ToInt64 = Cast[DstT=DT_INT64, SrcT=DT_INT32, Truncate=false, _output_shapes=[[10]], _device=&quot;/job:localhost/replica:0/task:0/device:CPU:0&quot;](index_to_string/range)]]
2018-10-02 21:18:32.604980: E tensorflow_serving/util/retrier.cc:37] Loading servable: {name: mnist version: 1} failed: Invalid argument: NodeDef mentions attr 'Truncate' not in Op&lt;name=Cast; signature=x:SrcT -&gt; y:DstT; attr=SrcT:type; attr=DstT:type&gt;; NodeDef: index_to_string/ToInt64 = Cast[DstT=DT_INT64, SrcT=DT_INT32, Truncate=false, _output_shapes=[[10]], _device=&quot;/job:localhost/replica:0/task:0/device:CPU:0&quot;](index_to_string/range). (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
	 [[Node: index_to_string/ToInt64 = Cast[DstT=DT_INT64, SrcT=DT_INT32, Truncate=false, _output_shapes=[[10]], _device=&quot;/job:localhost/replica:0/task:0/device:CPU:0&quot;](index_to_string/range)]]
&lt;_Rendezvous of RPC that terminated with (StatusCode.UNAVAILABLE, Connect Failed)&gt;
&lt;_Rendezvous of RPC that terminated with (StatusCode.UNAVAILABLE, Connect Failed)&gt;
&lt;_Rendezvous of RPC that terminated with (StatusCode.DEADLINE_EXCEEDED, Deadline Exceeded)&gt;
&lt;_Rendezvous of RPC that terminated with (StatusCode.UNAVAILABLE, Connect Failed)&gt;
&lt;_Rendezvous of RPC that terminated with (StatusCode.DEADLINE_EXCEEDED, Deadline Exceeded)&gt;
&lt;_Rendezvous of RPC that terminated with (StatusCode.UNAVAILABLE, Connect Failed)&gt;
&lt;_Rendezvous of RPC that terminated with (StatusCode.DEADLINE_EXCEEDED, Deadline Exceeded)&gt;
&lt;_Rendezvous of RPC that terminated with (StatusCode.DEADLINE_EXCEEDED, Deadline Exceeded)&gt;
&lt;_Rendezvous of RPC that terminated with (StatusCode.DEADLINE_EXCEEDED, Deadline Exceeded)&gt;
&lt;_Rendezvous of RPC that terminated with (StatusCode.UNAVAILABLE, Connect Failed)&gt;
"><pre class="notranslate"><code class="notranslate">Training model...
Successfully downloaded train-images-idx3-ubyte.gz 9912422 bytes.
Extracting /tmp/train-images-idx3-ubyte.gz
Successfully downloaded train-labels-idx1-ubyte.gz 28881 bytes.
Extracting /tmp/train-labels-idx1-ubyte.gz
Successfully downloaded t10k-images-idx3-ubyte.gz 1648877 bytes.
Extracting /tmp/t10k-images-idx3-ubyte.gz
Successfully downloaded t10k-labels-idx1-ubyte.gz 4542 bytes.
Extracting /tmp/t10k-labels-idx1-ubyte.gz
training accuracy 0.9092
Done training!
Exporting trained model to /tmp/mnist_model/1
WARNING:tensorflow:From mnist_saved_model.py:139: calling add_meta_graph_and_variables (from tensorflow.python.saved_model.builder_impl) with legacy_init_op is deprecated and will be removed in a future version.
Instructions for updating:
Pass your op to the equivalent parameter main_op instead.
Done exporting!
Extracting /tmp/train-images-idx3-ubyte.gz
Extracting /tmp/train-labels-idx1-ubyte.gz
Extracting /tmp/t10k-images-idx3-ubyte.gz
Extracting /tmp/t10k-labels-idx1-ubyte.gz
&lt;_Rendezvous of RPC that terminated with (StatusCode.UNAVAILABLE, Connect Failed)&gt;
&lt;_Rendezvous of RPC that terminated with (StatusCode.UNAVAILABLE, Connect Failed)&gt;
&lt;_Rendezvous of RPC that terminated with (StatusCode.UNAVAILABLE, Connect Failed)&gt;
2018-10-02 21:18:32.604303: E external/org_tensorflow/tensorflow/core/common_runtime/executor.cc:697] Executor failed to create kernel. Invalid argument: NodeDef mentions attr 'Truncate' not in Op&lt;name=Cast; signature=x:SrcT -&gt; y:DstT; attr=SrcT:type; attr=DstT:type&gt;; NodeDef: index_to_string/ToInt64 = Cast[DstT=DT_INT64, SrcT=DT_INT32, Truncate=false, _output_shapes=[[10]], _device="/job:localhost/replica:0/task:0/device:CPU:0"](index_to_string/range). (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
	 [[Node: index_to_string/ToInt64 = Cast[DstT=DT_INT64, SrcT=DT_INT32, Truncate=false, _output_shapes=[[10]], _device="/job:localhost/replica:0/task:0/device:CPU:0"](index_to_string/range)]]
2018-10-02 21:18:32.604833: E external/org_tensorflow/tensorflow/core/common_runtime/executor.cc:697] Executor failed to create kernel. Invalid argument: NodeDef mentions attr 'Truncate' not in Op&lt;name=Cast; signature=x:SrcT -&gt; y:DstT; attr=SrcT:type; attr=DstT:type&gt;; NodeDef: index_to_string/ToInt64 = Cast[DstT=DT_INT64, SrcT=DT_INT32, Truncate=false, _output_shapes=[[10]], _device="/job:localhost/replica:0/task:0/device:CPU:0"](index_to_string/range). (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
	 [[Node: index_to_string/ToInt64 = Cast[DstT=DT_INT64, SrcT=DT_INT32, Truncate=false, _output_shapes=[[10]], _device="/job:localhost/replica:0/task:0/device:CPU:0"](index_to_string/range)]]
2018-10-02 21:18:32.604980: E tensorflow_serving/util/retrier.cc:37] Loading servable: {name: mnist version: 1} failed: Invalid argument: NodeDef mentions attr 'Truncate' not in Op&lt;name=Cast; signature=x:SrcT -&gt; y:DstT; attr=SrcT:type; attr=DstT:type&gt;; NodeDef: index_to_string/ToInt64 = Cast[DstT=DT_INT64, SrcT=DT_INT32, Truncate=false, _output_shapes=[[10]], _device="/job:localhost/replica:0/task:0/device:CPU:0"](index_to_string/range). (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
	 [[Node: index_to_string/ToInt64 = Cast[DstT=DT_INT64, SrcT=DT_INT32, Truncate=false, _output_shapes=[[10]], _device="/job:localhost/replica:0/task:0/device:CPU:0"](index_to_string/range)]]
&lt;_Rendezvous of RPC that terminated with (StatusCode.UNAVAILABLE, Connect Failed)&gt;
&lt;_Rendezvous of RPC that terminated with (StatusCode.UNAVAILABLE, Connect Failed)&gt;
&lt;_Rendezvous of RPC that terminated with (StatusCode.DEADLINE_EXCEEDED, Deadline Exceeded)&gt;
&lt;_Rendezvous of RPC that terminated with (StatusCode.UNAVAILABLE, Connect Failed)&gt;
&lt;_Rendezvous of RPC that terminated with (StatusCode.DEADLINE_EXCEEDED, Deadline Exceeded)&gt;
&lt;_Rendezvous of RPC that terminated with (StatusCode.UNAVAILABLE, Connect Failed)&gt;
&lt;_Rendezvous of RPC that terminated with (StatusCode.DEADLINE_EXCEEDED, Deadline Exceeded)&gt;
&lt;_Rendezvous of RPC that terminated with (StatusCode.DEADLINE_EXCEEDED, Deadline Exceeded)&gt;
&lt;_Rendezvous of RPC that terminated with (StatusCode.DEADLINE_EXCEEDED, Deadline Exceeded)&gt;
&lt;_Rendezvous of RPC that terminated with (StatusCode.UNAVAILABLE, Connect Failed)&gt;

</code></pre></div>