<h1 dir="auto"><g-emoji class="g-emoji" alias="bug" fallback-src="https://github.githubassets.com/images/icons/emoji/unicode/1f41b.png">🐛</g-emoji> Bug</h1>
<h2 dir="auto">Information</h2>
<p dir="auto">Model I am using TFBertEncoder:</p>
<p dir="auto">Language I am using the model on English:</p>
<p dir="auto">The problem arises when using:</p>
<ul class="contains-task-list">
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked="">  my own modified scripts: (give details below)</li>
</ul>
<p dir="auto">The tasks I am working on is:</p>
<ul class="contains-task-list">
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked="">  my own task or dataset: (give details below)</li>
</ul>
<h2 dir="auto">To reproduce</h2>
<p dir="auto">Steps to reproduce the behavior:</p>
<ol dir="auto">
<li>When I use, TFBertEncoder, I get an error.</li>
</ol>
<p dir="auto">Here is my code.</p>
<div class="highlight highlight-source-python notranslate position-relative overflow-auto" dir="auto" data-snippet-clipboard-copy-content="import tensorflow as tf
import numpy as np
from transformers.modeling_tf_bert import BertConfig, TFBertEncoder

print(tf.__name__, tf.__version__)
input_a = tf.keras.layers.Input(shape=(91, 128))

config = BertConfig()
config.hidden_size = 128
config.num_attention_heads = 4

# config.output_attentions = False
# config.output_hidden_states = False

head_mask = [None for _ in range(config.num_hidden_layers)]
encoder_output = TFBertEncoder(config=config)([input_a, None, head_mask])[0]
print(encoder_output.shape)

test_out = tf.keras.layers.Dense(128)(encoder_output)
print(test_out.shape)"><pre class="notranslate"><span class="pl-k">import</span> <span class="pl-s1">tensorflow</span> <span class="pl-k">as</span> <span class="pl-s1">tf</span>
<span class="pl-k">import</span> <span class="pl-s1">numpy</span> <span class="pl-k">as</span> <span class="pl-s1">np</span>
<span class="pl-k">from</span> <span class="pl-s1">transformers</span>.<span class="pl-s1">modeling_tf_bert</span> <span class="pl-k">import</span> <span class="pl-v">BertConfig</span>, <span class="pl-v">TFBertEncoder</span>

<span class="pl-en">print</span>(<span class="pl-s1">tf</span>.<span class="pl-s1">__name__</span>, <span class="pl-s1">tf</span>.<span class="pl-s1">__version__</span>)
<span class="pl-s1">input_a</span> <span class="pl-c1">=</span> <span class="pl-s1">tf</span>.<span class="pl-s1">keras</span>.<span class="pl-s1">layers</span>.<span class="pl-v">Input</span>(<span class="pl-s1">shape</span><span class="pl-c1">=</span>(<span class="pl-c1">91</span>, <span class="pl-c1">128</span>))

<span class="pl-s1">config</span> <span class="pl-c1">=</span> <span class="pl-v">BertConfig</span>()
<span class="pl-s1">config</span>.<span class="pl-s1">hidden_size</span> <span class="pl-c1">=</span> <span class="pl-c1">128</span>
<span class="pl-s1">config</span>.<span class="pl-s1">num_attention_heads</span> <span class="pl-c1">=</span> <span class="pl-c1">4</span>

<span class="pl-c"># config.output_attentions = False</span>
<span class="pl-c"># config.output_hidden_states = False</span>

<span class="pl-s1">head_mask</span> <span class="pl-c1">=</span> [<span class="pl-c1">None</span> <span class="pl-k">for</span> <span class="pl-s1">_</span> <span class="pl-c1">in</span> <span class="pl-en">range</span>(<span class="pl-s1">config</span>.<span class="pl-s1">num_hidden_layers</span>)]
<span class="pl-s1">encoder_output</span> <span class="pl-c1">=</span> <span class="pl-v">TFBertEncoder</span>(<span class="pl-s1">config</span><span class="pl-c1">=</span><span class="pl-s1">config</span>)([<span class="pl-s1">input_a</span>, <span class="pl-c1">None</span>, <span class="pl-s1">head_mask</span>])[<span class="pl-c1">0</span>]
<span class="pl-en">print</span>(<span class="pl-s1">encoder_output</span>.<span class="pl-s1">shape</span>)

<span class="pl-s1">test_out</span> <span class="pl-c1">=</span> <span class="pl-s1">tf</span>.<span class="pl-s1">keras</span>.<span class="pl-s1">layers</span>.<span class="pl-v">Dense</span>(<span class="pl-c1">128</span>)(<span class="pl-s1">encoder_output</span>)
<span class="pl-en">print</span>(<span class="pl-s1">test_out</span>.<span class="pl-s1">shape</span>)</pre></div>
<h2 dir="auto">Expected behavior</h2>
<p dir="auto">Here is the error:</p>
<div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="(None, 91, 128)
2020-06-03 11:18:10.160647: W tensorflow/core/common_runtime/base_collective_executor.cc:217] BaseCollectiveExecutor::StartAbort Failed precondition: Error while reading resource variable _AnonymousVar189 from Container: localhost. This could mean that the variable was uninitialized. Not found: Resource localhost/_AnonymousVar189/class tensorflow::Var does not exist.
	 [[{{node output_23/dense/BiasAdd/ReadVariableOp}}]]
Traceback (most recent call last):
  File &quot;D:/python/tx/TEST.py&quot;, line 16, in &lt;module&gt;
    a = tf.keras.layers.Dense(128)(encoder_output)
  File &quot;D:\Anaconda3\lib\site-packages\tensorflow_core\python\keras\engine\base_layer.py&quot;, line 720, in __call__
    base_layer_utils.create_keras_history(inputs)
  File &quot;D:\Anaconda3\lib\site-packages\tensorflow_core\python\keras\engine\base_layer_utils.py&quot;, line 187, in create_keras_history
    _, created_layers = _create_keras_history_helper(tensors, set(), [])
  File &quot;D:\Anaconda3\lib\site-packages\tensorflow_core\python\keras\engine\base_layer_utils.py&quot;, line 249, in _create_keras_history_helper
    layer_inputs, processed_ops, created_layers)
  File &quot;D:\Anaconda3\lib\site-packages\tensorflow_core\python\keras\engine\base_layer_utils.py&quot;, line 249, in _create_keras_history_helper
    layer_inputs, processed_ops, created_layers)
  File &quot;D:\Anaconda3\lib\site-packages\tensorflow_core\python\keras\engine\base_layer_utils.py&quot;, line 249, in _create_keras_history_helper
    layer_inputs, processed_ops, created_layers)
  [Previous line repeated 5 more times]
  File &quot;D:\Anaconda3\lib\site-packages\tensorflow_core\python\keras\engine\base_layer_utils.py&quot;, line 247, in _create_keras_history_helper
    constants[i] = backend.function([], op_input)([])
  File &quot;D:\Anaconda3\lib\site-packages\tensorflow_core\python\keras\backend.py&quot;, line 3727, in __call__
    outputs = self._graph_fn(*converted_inputs)
  File &quot;D:\Anaconda3\lib\site-packages\tensorflow_core\python\eager\function.py&quot;, line 1551, in __call__
    return self._call_impl(args, kwargs)
  File &quot;D:\Anaconda3\lib\site-packages\tensorflow_core\python\eager\function.py&quot;, line 1591, in _call_impl
    return self._call_flat(args, self.captured_inputs, cancellation_manager)
  File &quot;D:\Anaconda3\lib\site-packages\tensorflow_core\python\eager\function.py&quot;, line 1692, in _call_flat
    ctx, args, cancellation_manager=cancellation_manager))
  File &quot;D:\Anaconda3\lib\site-packages\tensorflow_core\python\eager\function.py&quot;, line 545, in call
    ctx=ctx)
  File &quot;D:\Anaconda3\lib\site-packages\tensorflow_core\python\eager\execute.py&quot;, line 67, in quick_execute
    six.raise_from(core._status_to_exception(e.code, message), None)
  File &quot;&lt;string&gt;&quot;, line 3, in raise_from
tensorflow.python.framework.errors_impl.FailedPreconditionError:  Error while reading resource variable _AnonymousVar189 from Container: localhost. This could mean that the variable was uninitialized. Not found: Resource localhost/_AnonymousVar189/class tensorflow::Var does not exist.
	 [[node output_23/dense/BiasAdd/ReadVariableOp (defined at /python/tx/TEST.py:16) ]] [Op:__inference_keras_scratch_graph_5205]

Function call stack:
keras_scratch_graph"><pre class="notranslate"><code class="notranslate">(None, 91, 128)
2020-06-03 11:18:10.160647: W tensorflow/core/common_runtime/base_collective_executor.cc:217] BaseCollectiveExecutor::StartAbort Failed precondition: Error while reading resource variable _AnonymousVar189 from Container: localhost. This could mean that the variable was uninitialized. Not found: Resource localhost/_AnonymousVar189/class tensorflow::Var does not exist.
	 [[{{node output_23/dense/BiasAdd/ReadVariableOp}}]]
Traceback (most recent call last):
  File "D:/python/tx/TEST.py", line 16, in &lt;module&gt;
    a = tf.keras.layers.Dense(128)(encoder_output)
  File "D:\Anaconda3\lib\site-packages\tensorflow_core\python\keras\engine\base_layer.py", line 720, in __call__
    base_layer_utils.create_keras_history(inputs)
  File "D:\Anaconda3\lib\site-packages\tensorflow_core\python\keras\engine\base_layer_utils.py", line 187, in create_keras_history
    _, created_layers = _create_keras_history_helper(tensors, set(), [])
  File "D:\Anaconda3\lib\site-packages\tensorflow_core\python\keras\engine\base_layer_utils.py", line 249, in _create_keras_history_helper
    layer_inputs, processed_ops, created_layers)
  File "D:\Anaconda3\lib\site-packages\tensorflow_core\python\keras\engine\base_layer_utils.py", line 249, in _create_keras_history_helper
    layer_inputs, processed_ops, created_layers)
  File "D:\Anaconda3\lib\site-packages\tensorflow_core\python\keras\engine\base_layer_utils.py", line 249, in _create_keras_history_helper
    layer_inputs, processed_ops, created_layers)
  [Previous line repeated 5 more times]
  File "D:\Anaconda3\lib\site-packages\tensorflow_core\python\keras\engine\base_layer_utils.py", line 247, in _create_keras_history_helper
    constants[i] = backend.function([], op_input)([])
  File "D:\Anaconda3\lib\site-packages\tensorflow_core\python\keras\backend.py", line 3727, in __call__
    outputs = self._graph_fn(*converted_inputs)
  File "D:\Anaconda3\lib\site-packages\tensorflow_core\python\eager\function.py", line 1551, in __call__
    return self._call_impl(args, kwargs)
  File "D:\Anaconda3\lib\site-packages\tensorflow_core\python\eager\function.py", line 1591, in _call_impl
    return self._call_flat(args, self.captured_inputs, cancellation_manager)
  File "D:\Anaconda3\lib\site-packages\tensorflow_core\python\eager\function.py", line 1692, in _call_flat
    ctx, args, cancellation_manager=cancellation_manager))
  File "D:\Anaconda3\lib\site-packages\tensorflow_core\python\eager\function.py", line 545, in call
    ctx=ctx)
  File "D:\Anaconda3\lib\site-packages\tensorflow_core\python\eager\execute.py", line 67, in quick_execute
    six.raise_from(core._status_to_exception(e.code, message), None)
  File "&lt;string&gt;", line 3, in raise_from
tensorflow.python.framework.errors_impl.FailedPreconditionError:  Error while reading resource variable _AnonymousVar189 from Container: localhost. This could mean that the variable was uninitialized. Not found: Resource localhost/_AnonymousVar189/class tensorflow::Var does not exist.
	 [[node output_23/dense/BiasAdd/ReadVariableOp (defined at /python/tx/TEST.py:16) ]] [Op:__inference_keras_scratch_graph_5205]

Function call stack:
keras_scratch_graph
</code></pre></div>
<h2 dir="auto">Environment info</h2>
<ul dir="auto">
<li><code class="notranslate">transformers</code> version: 2.3.0 (in conda list)</li>
<li>Platform:</li>
<li>Python version:3.7</li>
<li>PyTorch version (GPU?):</li>
<li>Tensorflow version (GPU?):TF2.1.0(GPU)</li>
<li>Using GPU in script?:</li>
<li>Using distributed or parallel set-up in script?:No</li>
</ul>
<h1 dir="auto"><g-emoji class="g-emoji" alias="bug" fallback-src="https://github.githubassets.com/images/icons/emoji/unicode/1f41b.png">🐛</g-emoji> Bug</h1>
<h2 dir="auto">Information</h2>
<p dir="auto">Model I am using TFBertEncoder:</p>
<p dir="auto">Language I am using the model on English:</p>
<p dir="auto">The problem arises when using:</p>
<ul class="contains-task-list">
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox"> my own modified scripts: (give details below)</li>
</ul>
<p dir="auto">The tasks I am working on is:</p>
<ul class="contains-task-list">
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox"> my own task or dataset: (give details below)</li>
</ul>
<h2 dir="auto">To reproduce</h2>
<p dir="auto">Steps to reproduce the behavior:</p>
<ol dir="auto">
<li>When I use, TFBertEncoder, I get an error.</li>
</ol>
<p dir="auto">Here is my code.</p>
<div class="highlight highlight-source-python notranslate position-relative overflow-auto" dir="auto" data-snippet-clipboard-copy-content="import tensorflow as tf
import numpy as np
from transformers.modeling_tf_bert import BertConfig, TFBertEncoder

print(tf.__name__, tf.__version__)
input_a = tf.keras.layers.Input(shape=(91, 128))

config = BertConfig()
config.hidden_size = 128
config.num_attention_heads = 4

# config.output_attentions = False
# config.output_hidden_states = False

head_mask = [None for _ in range(config.num_hidden_layers)]
encoder_output = TFBertEncoder(config=config)([input_a, None, head_mask])[0]
print(encoder_output.shape)

test_out = tf.keras.layers.Dense(128)(encoder_output)
print(test_out.shape)"><pre class="notranslate"><span class="pl-k">import</span> <span class="pl-s1">tensorflow</span> <span class="pl-k">as</span> <span class="pl-s1">tf</span>
<span class="pl-k">import</span> <span class="pl-s1">numpy</span> <span class="pl-k">as</span> <span class="pl-s1">np</span>
<span class="pl-k">from</span> <span class="pl-s1">transformers</span>.<span class="pl-s1">modeling_tf_bert</span> <span class="pl-k">import</span> <span class="pl-v">BertConfig</span>, <span class="pl-v">TFBertEncoder</span>

<span class="pl-en">print</span>(<span class="pl-s1">tf</span>.<span class="pl-s1">__name__</span>, <span class="pl-s1">tf</span>.<span class="pl-s1">__version__</span>)
<span class="pl-s1">input_a</span> <span class="pl-c1">=</span> <span class="pl-s1">tf</span>.<span class="pl-s1">keras</span>.<span class="pl-s1">layers</span>.<span class="pl-v">Input</span>(<span class="pl-s1">shape</span><span class="pl-c1">=</span>(<span class="pl-c1">91</span>, <span class="pl-c1">128</span>))

<span class="pl-s1">config</span> <span class="pl-c1">=</span> <span class="pl-v">BertConfig</span>()
<span class="pl-s1">config</span>.<span class="pl-s1">hidden_size</span> <span class="pl-c1">=</span> <span class="pl-c1">128</span>
<span class="pl-s1">config</span>.<span class="pl-s1">num_attention_heads</span> <span class="pl-c1">=</span> <span class="pl-c1">4</span>

<span class="pl-c"># config.output_attentions = False</span>
<span class="pl-c"># config.output_hidden_states = False</span>

<span class="pl-s1">head_mask</span> <span class="pl-c1">=</span> [<span class="pl-c1">None</span> <span class="pl-k">for</span> <span class="pl-s1">_</span> <span class="pl-c1">in</span> <span class="pl-en">range</span>(<span class="pl-s1">config</span>.<span class="pl-s1">num_hidden_layers</span>)]
<span class="pl-s1">encoder_output</span> <span class="pl-c1">=</span> <span class="pl-v">TFBertEncoder</span>(<span class="pl-s1">config</span><span class="pl-c1">=</span><span class="pl-s1">config</span>)([<span class="pl-s1">input_a</span>, <span class="pl-c1">None</span>, <span class="pl-s1">head_mask</span>])[<span class="pl-c1">0</span>]
<span class="pl-en">print</span>(<span class="pl-s1">encoder_output</span>.<span class="pl-s1">shape</span>)

<span class="pl-s1">test_out</span> <span class="pl-c1">=</span> <span class="pl-s1">tf</span>.<span class="pl-s1">keras</span>.<span class="pl-s1">layers</span>.<span class="pl-v">Dense</span>(<span class="pl-c1">128</span>)(<span class="pl-s1">encoder_output</span>)
<span class="pl-en">print</span>(<span class="pl-s1">test_out</span>.<span class="pl-s1">shape</span>)</pre></div>
<h2 dir="auto">Expected behavior</h2>
<p dir="auto">Here is the error:</p>
<div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="(None, 91, 128)
2020-06-03 11:18:10.160647: W tensorflow/core/common_runtime/base_collective_executor.cc:217] BaseCollectiveExecutor::StartAbort Failed precondition: Error while reading resource variable _AnonymousVar189 from Container: localhost. This could mean that the variable was uninitialized. Not found: Resource localhost/_AnonymousVar189/class tensorflow::Var does not exist.
	 [[{{node output_23/dense/BiasAdd/ReadVariableOp}}]]
Traceback (most recent call last):
  File &quot;D:/python/tx/TEST.py&quot;, line 16, in &lt;module&gt;
    a = tf.keras.layers.Dense(128)(encoder_output)
  File &quot;D:\Anaconda3\lib\site-packages\tensorflow_core\python\keras\engine\base_layer.py&quot;, line 720, in __call__
    base_layer_utils.create_keras_history(inputs)
  File &quot;D:\Anaconda3\lib\site-packages\tensorflow_core\python\keras\engine\base_layer_utils.py&quot;, line 187, in create_keras_history
    _, created_layers = _create_keras_history_helper(tensors, set(), [])
  File &quot;D:\Anaconda3\lib\site-packages\tensorflow_core\python\keras\engine\base_layer_utils.py&quot;, line 249, in _create_keras_history_helper
    layer_inputs, processed_ops, created_layers)
  File &quot;D:\Anaconda3\lib\site-packages\tensorflow_core\python\keras\engine\base_layer_utils.py&quot;, line 249, in _create_keras_history_helper
    layer_inputs, processed_ops, created_layers)
  File &quot;D:\Anaconda3\lib\site-packages\tensorflow_core\python\keras\engine\base_layer_utils.py&quot;, line 249, in _create_keras_history_helper
    layer_inputs, processed_ops, created_layers)
  [Previous line repeated 5 more times]
  File &quot;D:\Anaconda3\lib\site-packages\tensorflow_core\python\keras\engine\base_layer_utils.py&quot;, line 247, in _create_keras_history_helper
    constants[i] = backend.function([], op_input)([])
  File &quot;D:\Anaconda3\lib\site-packages\tensorflow_core\python\keras\backend.py&quot;, line 3727, in __call__
    outputs = self._graph_fn(*converted_inputs)
  File &quot;D:\Anaconda3\lib\site-packages\tensorflow_core\python\eager\function.py&quot;, line 1551, in __call__
    return self._call_impl(args, kwargs)
  File &quot;D:\Anaconda3\lib\site-packages\tensorflow_core\python\eager\function.py&quot;, line 1591, in _call_impl
    return self._call_flat(args, self.captured_inputs, cancellation_manager)
  File &quot;D:\Anaconda3\lib\site-packages\tensorflow_core\python\eager\function.py&quot;, line 1692, in _call_flat
    ctx, args, cancellation_manager=cancellation_manager))
  File &quot;D:\Anaconda3\lib\site-packages\tensorflow_core\python\eager\function.py&quot;, line 545, in call
    ctx=ctx)
  File &quot;D:\Anaconda3\lib\site-packages\tensorflow_core\python\eager\execute.py&quot;, line 67, in quick_execute
    six.raise_from(core._status_to_exception(e.code, message), None)
  File &quot;&lt;string&gt;&quot;, line 3, in raise_from
tensorflow.python.framework.errors_impl.FailedPreconditionError:  Error while reading resource variable _AnonymousVar189 from Container: localhost. This could mean that the variable was uninitialized. Not found: Resource localhost/_AnonymousVar189/class tensorflow::Var does not exist.
	 [[node output_23/dense/BiasAdd/ReadVariableOp (defined at /python/tx/TEST.py:16) ]] [Op:__inference_keras_scratch_graph_5205]

Function call stack:
keras_scratch_graph"><pre class="notranslate"><code class="notranslate">(None, 91, 128)
2020-06-03 11:18:10.160647: W tensorflow/core/common_runtime/base_collective_executor.cc:217] BaseCollectiveExecutor::StartAbort Failed precondition: Error while reading resource variable _AnonymousVar189 from Container: localhost. This could mean that the variable was uninitialized. Not found: Resource localhost/_AnonymousVar189/class tensorflow::Var does not exist.
	 [[{{node output_23/dense/BiasAdd/ReadVariableOp}}]]
Traceback (most recent call last):
  File "D:/python/tx/TEST.py", line 16, in &lt;module&gt;
    a = tf.keras.layers.Dense(128)(encoder_output)
  File "D:\Anaconda3\lib\site-packages\tensorflow_core\python\keras\engine\base_layer.py", line 720, in __call__
    base_layer_utils.create_keras_history(inputs)
  File "D:\Anaconda3\lib\site-packages\tensorflow_core\python\keras\engine\base_layer_utils.py", line 187, in create_keras_history
    _, created_layers = _create_keras_history_helper(tensors, set(), [])
  File "D:\Anaconda3\lib\site-packages\tensorflow_core\python\keras\engine\base_layer_utils.py", line 249, in _create_keras_history_helper
    layer_inputs, processed_ops, created_layers)
  File "D:\Anaconda3\lib\site-packages\tensorflow_core\python\keras\engine\base_layer_utils.py", line 249, in _create_keras_history_helper
    layer_inputs, processed_ops, created_layers)
  File "D:\Anaconda3\lib\site-packages\tensorflow_core\python\keras\engine\base_layer_utils.py", line 249, in _create_keras_history_helper
    layer_inputs, processed_ops, created_layers)
  [Previous line repeated 5 more times]
  File "D:\Anaconda3\lib\site-packages\tensorflow_core\python\keras\engine\base_layer_utils.py", line 247, in _create_keras_history_helper
    constants[i] = backend.function([], op_input)([])
  File "D:\Anaconda3\lib\site-packages\tensorflow_core\python\keras\backend.py", line 3727, in __call__
    outputs = self._graph_fn(*converted_inputs)
  File "D:\Anaconda3\lib\site-packages\tensorflow_core\python\eager\function.py", line 1551, in __call__
    return self._call_impl(args, kwargs)
  File "D:\Anaconda3\lib\site-packages\tensorflow_core\python\eager\function.py", line 1591, in _call_impl
    return self._call_flat(args, self.captured_inputs, cancellation_manager)
  File "D:\Anaconda3\lib\site-packages\tensorflow_core\python\eager\function.py", line 1692, in _call_flat
    ctx, args, cancellation_manager=cancellation_manager))
  File "D:\Anaconda3\lib\site-packages\tensorflow_core\python\eager\function.py", line 545, in call
    ctx=ctx)
  File "D:\Anaconda3\lib\site-packages\tensorflow_core\python\eager\execute.py", line 67, in quick_execute
    six.raise_from(core._status_to_exception(e.code, message), None)
  File "&lt;string&gt;", line 3, in raise_from
tensorflow.python.framework.errors_impl.FailedPreconditionError:  Error while reading resource variable _AnonymousVar189 from Container: localhost. This could mean that the variable was uninitialized. Not found: Resource localhost/_AnonymousVar189/class tensorflow::Var does not exist.
	 [[node output_23/dense/BiasAdd/ReadVariableOp (defined at /python/tx/TEST.py:16) ]] [Op:__inference_keras_scratch_graph_5205]

Function call stack:
keras_scratch_graph
</code></pre></div>
<h2 dir="auto">Environment info</h2>

<ul dir="auto">
<li><code class="notranslate">transformers</code> version: 2.3.0 (in conda list)</li>
<li>Platform:</li>
<li>Python version:3.7</li>
<li>PyTorch version (GPU?):</li>
<li>Tensorflow version (GPU?):TF2.1.0(GPU)</li>
<li>Using GPU in script?:</li>
<li>Using distributed or parallel set-up in script?:No</li>
</ul>