Check failure when running tf.keras.layers.RepeatVector
@dmc1778 The issue is not getting replicated on colab using TF v2.13 and tf-nightly, please find the [gist](https://colab.research.google.com/gist/sushreebarsa/1ac4bd8ac80db3c5453fca1d9e36f14d/61643.ipynb) here. Thank you!  > @dmc1778 The issue is not getting replicated on colab using TF v2.13 and tf-nightly, please find the [gist](https://colab.research.google.com/gist/sushreebarsa/1ac4bd8ac80db3c5453fca1d9e36f14d/61643.ipynb) here. Thank you!

Thanks @sushreebarsa . My session on colab still getting crashed, probably due to check failure, please find the log message below:

```
{"pid":7,"type":"jupyter","level":40,"msg":"[D 05:53:09.866 NotebookApp] Searching ['/root/.jupyter', '/root/.local/etc/jupyter', '/usr/etc/jupyter', '/usr/local/etc/jupyter', '/etc/jupyter'] for config files","time":"2023-08-21T05:53:09.867Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"[D 05:53:09.866 NotebookApp] Searching ['/root/.jupyter', '/root/.local/etc/jupyter', '/usr/etc/jupyter', '/usr/local/etc/jupyter', '/etc/jupyter'] for config files","time":"2023-08-21T05:53:09.870Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"[D 05:53:09.866 NotebookApp] Looking for jupyter_config in /etc/jupyter","time":"2023-08-21T05:53:09.868Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"[D 05:53:09.878 NotebookApp] Looking for jupyter_config in /usr/local/etc/jupyter","time":"2023-08-21T05:53:09.882Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"[D 05:53:09.883 NotebookApp] Looking for jupyter_config in /usr/etc/jupyter","time":"2023-08-21T05:53:09.887Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"[D 05:53:09.883 NotebookApp] Looking for jupyter_config in /root/.local/etc/jupyter","time":"2023-08-21T05:53:09.887Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"[D 05:53:09.884 NotebookApp] Looking for jupyter_config in /root/.jupyter","time":"2023-08-21T05:53:09.887Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"[D 05:53:09.866 NotebookApp] Looking for jupyter_config in /etc/jupyter","time":"2023-08-21T05:53:09.871Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"[D 05:53:09.869 NotebookApp] Looking for jupyter_config in /usr/local/etc/jupyter","time":"2023-08-21T05:53:09.873Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"[D 05:53:09.870 NotebookApp] Looking for jupyter_config in /usr/etc/jupyter","time":"2023-08-21T05:53:09.882Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"[D 05:53:09.870 NotebookApp] Looking for jupyter_config in /root/.local/etc/jupyter","time":"2023-08-21T05:53:09.882Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"[D 05:53:09.871 NotebookApp] Looking for jupyter_config in /root/.jupyter","time":"2023-08-21T05:53:09.883Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"[D 05:53:09.871 NotebookApp] Looking for jupyter_notebook_config in /etc/jupyter","time":"2023-08-21T05:53:09.883Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"[D 05:53:09.875 NotebookApp] Loaded config file: /etc/jupyter/jupyter_notebook_config.py","time":"2023-08-21T05:53:09.884Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"[D 05:53:09.876 NotebookApp] Looking for jupyter_notebook_config in /usr/local/etc/jupyter","time":"2023-08-21T05:53:09.886Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"[D 05:53:09.876 NotebookApp] Loaded config file: /usr/local/etc/jupyter/jupyter_notebook_config.json","time":"2023-08-21T05:53:09.886Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"[D 05:53:09.877 NotebookApp] Looking for jupyter_notebook_config in /usr/etc/jupyter","time":"2023-08-21T05:53:09.887Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"[D 05:53:09.877 NotebookApp] Looking for jupyter_notebook_config in /root/.local/etc/jupyter","time":"2023-08-21T05:53:09.888Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"[D 05:53:09.877 NotebookApp] Looking for jupyter_notebook_config in /root/.jupyter","time":"2023-08-21T05:53:09.891Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"[D 05:53:09.879 NotebookApp] Loaded config file: /root/.jupyter/jupyter_notebook_config.py","time":"2023-08-21T05:53:09.891Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"[D 05:53:09.889 NotebookApp] Looking for jupyter_notebook_config in /etc/jupyter","time":"2023-08-21T05:53:09.889Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"[D 05:53:09.889 NotebookApp] Loaded config file: /etc/jupyter/jupyter_notebook_config.py","time":"2023-08-21T05:53:09.891Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"[D 05:53:09.890 NotebookApp] Looking for jupyter_notebook_config in /usr/local/etc/jupyter","time":"2023-08-21T05:53:09.892Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"[D 05:53:09.890 NotebookApp] Loaded config file: /usr/local/etc/jupyter/jupyter_notebook_config.json","time":"2023-08-21T05:53:09.892Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"[D 05:53:09.890 NotebookApp] Looking for jupyter_notebook_config in /usr/etc/jupyter","time":"2023-08-21T05:53:09.892Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"[D 05:53:09.890 NotebookApp] Looking for jupyter_notebook_config in /root/.local/etc/jupyter","time":"2023-08-21T05:53:09.892Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"[D 05:53:09.890 NotebookApp] Looking for jupyter_notebook_config in /root/.jupyter","time":"2023-08-21T05:53:09.892Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"[D 05:53:09.891 NotebookApp] Loaded config file: /root/.jupyter/jupyter_notebook_config.py","time":"2023-08-21T05:53:09.895Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"    \t/etc/jupyter/jupyter_notebook_config.json","time":"2023-08-21T05:53:10.735Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"    \t/usr/local/etc/jupyter/jupyter_notebook_config.d/panel-client-jupyter.json","time":"2023-08-21T05:53:10.745Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"    \t/usr/local/etc/jupyter/jupyter_notebook_config.json","time":"2023-08-21T05:53:10.745Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"    \t/usr/etc/jupyter/jupyter_notebook_config.json","time":"2023-08-21T05:53:10.746Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"    \t/root/.local/etc/jupyter/jupyter_notebook_config.json","time":"2023-08-21T05:53:10.747Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"    \t/root/.jupyter/jupyter_notebook_config.json","time":"2023-08-21T05:53:10.747Z","v":0}
{"pid":7,"type":"jupyter","level":30,"msg":"Writing notebook server cookie secret to /root/.local/share/jupyter/runtime/notebook_cookie_secret","time":"2023-08-21T05:53:10.765Z","v":0}
{"pid":7,"type":"jupyter","level":30,"msg":"Authentication of /metrics is OFF, since other authentication is disabled.","time":"2023-08-21T05:53:10.771Z","v":0}
{"pid":7,"type":"jupyter","level":30,"msg":"google.colab serverextension initialized.","time":"2023-08-21T05:53:10.836Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"    \t/etc/jupyter/jupyter_notebook_config.json","time":"2023-08-21T05:53:10.878Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"    \t/usr/local/etc/jupyter/jupyter_notebook_config.d/panel-client-jupyter.json","time":"2023-08-21T05:53:10.880Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"    \t/usr/local/etc/jupyter/jupyter_notebook_config.json","time":"2023-08-21T05:53:10.880Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"    \t/usr/etc/jupyter/jupyter_notebook_config.json","time":"2023-08-21T05:53:10.882Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"    \t/root/.local/etc/jupyter/jupyter_notebook_config.json","time":"2023-08-21T05:53:10.883Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"    \t/root/.jupyter/jupyter_notebook_config.json","time":"2023-08-21T05:53:10.884Z","v":0}
{"pid":7,"type":"jupyter","level":30,"msg":"Writing notebook server cookie secret to /root/.local/share/jupyter/runtime/notebook_cookie_secret","time":"2023-08-21T05:53:10.893Z","v":0}
{"pid":7,"type":"jupyter","level":30,"msg":"Authentication of /metrics is OFF, since other authentication is disabled.","time":"2023-08-21T05:53:10.894Z","v":0}
{"pid":7,"type":"jupyter","level":30,"msg":"google.colab serverextension initialized.","time":"2023-08-21T05:53:10.945Z","v":0}
{"pid":7,"type":"jupyter","level":30,"msg":"Serving notebooks from local directory: /","time":"2023-08-21T05:53:15.513Z","v":0}
{"pid":7,"type":"jupyter","level":30,"msg":"Jupyter Notebook 6.5.5 is running at:","time":"2023-08-21T05:53:15.514Z","v":0}
{"pid":7,"type":"jupyter","level":30,"msg":"Serving notebooks from local directory: /","time":"2023-08-21T05:53:15.521Z","v":0}
{"pid":7,"type":"jupyter","level":30,"msg":"Jupyter Notebook 6.5.5 is running at:","time":"2023-08-21T05:53:15.521Z","v":0}
{"pid":7,"type":"jupyter","level":30,"msg":"http://172.28.0.2:9000/","time":"2023-08-21T05:53:15.521Z","v":0}
{"pid":7,"type":"jupyter","level":30,"msg":"Use Control-C to stop this server and shut down all kernels (twice to skip confirmation).","time":"2023-08-21T05:53:15.522Z","v":0}
{"pid":7,"type":"jupyter","level":30,"msg":"http://172.28.0.12:9000/","time":"2023-08-21T05:53:15.523Z","v":0}
{"pid":7,"type":"jupyter","level":30,"msg":"Use Control-C to stop this server and shut down all kernels (twice to skip confirmation).","time":"2023-08-21T05:53:15.523Z","v":0}
{"pid":7,"type":"jupyter","level":30,"msg":"Kernel started: 7be3ebb5-8079-41dd-a058-72f1e271f55f, name: python3","time":"2023-08-21T05:53:32.402Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"2023-08-21 05:53:38.426472: I tensorflow/core/platform/cpu_feature_guard.cc:182] This TensorFlow binary is optimized to use available CPU instructions in performance-critical operations.","time":"2023-08-21T05:53:38.426Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"To enable the following instructions: AVX2 AVX512F FMA, in other operations, rebuild TensorFlow with the appropriate compiler flags.","time":"2023-08-21T05:53:38.426Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"2023-08-21 05:53:39.614903: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Could not find TensorRT","time":"2023-08-21T05:53:39.615Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"2023-08-21 05:53:43.858531: I tensorflow/compiler/xla/stream_executor/cuda/cuda_gpu_executor.cc:996] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero. See more at https://github.com/torvalds/linux/blob/v6.0/Documentation/ABI/testing/sysfs-bus-pci#L344-L355","time":"2023-08-21T05:53:43.858Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"2023-08-21 05:53:44.410103: I tensorflow/compiler/xla/stream_executor/cuda/cuda_gpu_executor.cc:996] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero. See more at https://github.com/torvalds/linux/blob/v6.0/Documentation/ABI/testing/sysfs-bus-pci#L344-L355","time":"2023-08-21T05:53:44.410Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"2023-08-21 05:53:44.410567: I tensorflow/compiler/xla/stream_executor/cuda/cuda_gpu_executor.cc:996] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero. See more at https://github.com/torvalds/linux/blob/v6.0/Documentation/ABI/testing/sysfs-bus-pci#L344-L355","time":"2023-08-21T05:53:44.410Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"2023-08-21 05:53:44.413324: I tensorflow/compiler/xla/stream_executor/cuda/cuda_gpu_executor.cc:996] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero. See more at https://github.com/torvalds/linux/blob/v6.0/Documentation/ABI/testing/sysfs-bus-pci#L344-L355","time":"2023-08-21T05:53:44.413Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"2023-08-21 05:53:44.413957: I tensorflow/compiler/xla/stream_executor/cuda/cuda_gpu_executor.cc:996] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero. See more at https://github.com/torvalds/linux/blob/v6.0/Documentation/ABI/testing/sysfs-bus-pci#L344-L355","time":"2023-08-21T05:53:44.414Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"2023-08-21 05:53:44.414476: I tensorflow/compiler/xla/stream_executor/cuda/cuda_gpu_executor.cc:996] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero. See more at https://github.com/torvalds/linux/blob/v6.0/Documentation/ABI/testing/sysfs-bus-pci#L344-L355","time":"2023-08-21T05:53:44.414Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"2023-08-21 05:53:48.373843: I tensorflow/compiler/xla/stream_executor/cuda/cuda_gpu_executor.cc:996] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero. See more at https://github.com/torvalds/linux/blob/v6.0/Documentation/ABI/testing/sysfs-bus-pci#L344-L355","time":"2023-08-21T05:53:48.374Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"2023-08-21 05:53:48.380854: I tensorflow/compiler/xla/stream_executor/cuda/cuda_gpu_executor.cc:996] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero. See more at https://github.com/torvalds/linux/blob/v6.0/Documentation/ABI/testing/sysfs-bus-pci#L344-L355","time":"2023-08-21T05:53:48.381Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"2023-08-21 05:53:48.381791: I tensorflow/compiler/xla/stream_executor/cuda/cuda_gpu_executor.cc:996] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero. See more at https://github.com/torvalds/linux/blob/v6.0/Documentation/ABI/testing/sysfs-bus-pci#L344-L355","time":"2023-08-21T05:53:48.381Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"2023-08-21 05:53:48.382383: W tensorflow/core/common_runtime/gpu/gpu_bfc_allocator.cc:47] Overriding orig_value setting because the TF_FORCE_GPU_ALLOW_GROWTH environment variable is set. Original config value was 0.","time":"2023-08-21T05:53:48.382Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"2023-08-21 05:53:48.382464: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1635] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 13664 MB memory:  -> device: 0, name: Tesla T4, pci bus id: 0000:00:04.0, compute capability: 7.5","time":"2023-08-21T05:53:48.382Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"2023-08-21 05:53:53.331521: I tensorflow/compiler/xla/stream_executor/cuda/cuda_dnn.cc:424] Loaded cuDNN version 8900","time":"2023-08-21T05:53:53.331Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"2023-08-21 05:53:53.332580: F tensorflow/compiler/xla/stream_executor/cuda/cuda_dnn.cc:959] Check failed: cudnnSetPoolingNdDescriptor( handle_.get(), (pooling_descriptor.mode() == dnn::PoolingMode::kMaximum ? cudnn_max_pooling_mode : CUDNN_POOLING_AVERAGE_COUNT_EXCLUDE_PADDING), propagate_nans ? CUDNN_PROPAGATE_NAN : CUDNN_NOT_PROPAGATE_NAN, nd, shape.data(), padding.data(), strides.data()) == CUDNN_STATUS_SUCCESS (3 vs. 0)","time":"2023-08-21T05:53:53.332Z","v":0}
{"pid":7,"type":"jupyter","level":30,"msg":"KernelRestarter: restarting kernel (1/5), keep random ports","time":"2023-08-21T05:53:56.402Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"WARNING:root:kernel 7be3ebb5-8079-41dd-a058-72f1e271f55f restarted","time":"2023-08-21T05:53:56.402Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"2023-08-21 05:59:13.376745: I tensorflow/core/platform/cpu_feature_guard.cc:182] This TensorFlow binary is optimized to use available CPU instructions in performance-critical operations.","time":"2023-08-21T05:59:13.376Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"To enable the following instructions: AVX2 AVX512F FMA, in other operations, rebuild TensorFlow with the appropriate compiler flags.","time":"2023-08-21T05:59:13.377Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"2023-08-21 05:59:16.272217: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Could not find TensorRT","time":"2023-08-21T05:59:16.272Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"2023-08-21 05:59:33.700495: I tensorflow/compiler/xla/stream_executor/cuda/cuda_gpu_executor.cc:995] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero. See more at https://github.com/torvalds/linux/blob/v6.0/Documentation/ABI/testing/sysfs-bus-pci#L344-L355","time":"2023-08-21T05:59:33.700Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"2023-08-21 05:59:34.230690: I tensorflow/compiler/xla/stream_executor/cuda/cuda_gpu_executor.cc:995] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero. See more at https://github.com/torvalds/linux/blob/v6.0/Documentation/ABI/testing/sysfs-bus-pci#L344-L355","time":"2023-08-21T05:59:34.230Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"2023-08-21 05:59:34.231162: I tensorflow/compiler/xla/stream_executor/cuda/cuda_gpu_executor.cc:995] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero. See more at https://github.com/torvalds/linux/blob/v6.0/Documentation/ABI/testing/sysfs-bus-pci#L344-L355","time":"2023-08-21T05:59:34.231Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"2023-08-21 05:59:34.238614: I tensorflow/compiler/xla/stream_executor/cuda/cuda_gpu_executor.cc:995] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero. See more at https://github.com/torvalds/linux/blob/v6.0/Documentation/ABI/testing/sysfs-bus-pci#L344-L355","time":"2023-08-21T05:59:34.238Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"2023-08-21 05:59:34.242007: I tensorflow/compiler/xla/stream_executor/cuda/cuda_gpu_executor.cc:995] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero. See more at https://github.com/torvalds/linux/blob/v6.0/Documentation/ABI/testing/sysfs-bus-pci#L344-L355","time":"2023-08-21T05:59:34.242Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"2023-08-21 05:59:34.242295: I tensorflow/compiler/xla/stream_executor/cuda/cuda_gpu_executor.cc:995] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero. See more at https://github.com/torvalds/linux/blob/v6.0/Documentation/ABI/testing/sysfs-bus-pci#L344-L355","time":"2023-08-21T05:59:34.242Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"2023-08-21 05:59:35.389137: I tensorflow/compiler/xla/stream_executor/cuda/cuda_gpu_executor.cc:995] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero. See more at https://github.com/torvalds/linux/blob/v6.0/Documentation/ABI/testing/sysfs-bus-pci#L344-L355","time":"2023-08-21T05:59:35.389Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"2023-08-21 05:59:35.389644: I tensorflow/compiler/xla/stream_executor/cuda/cuda_gpu_executor.cc:995] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero. See more at https://github.com/torvalds/linux/blob/v6.0/Documentation/ABI/testing/sysfs-bus-pci#L344-L355","time":"2023-08-21T05:59:35.390Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"2023-08-21 05:59:35.390313: I tensorflow/compiler/xla/stream_executor/cuda/cuda_gpu_executor.cc:995] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero. See more at https://github.com/torvalds/linux/blob/v6.0/Documentation/ABI/testing/sysfs-bus-pci#L344-L355","time":"2023-08-21T05:59:35.390Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"2023-08-21 05:59:35.390544: W tensorflow/core/common_runtime/gpu/gpu_bfc_allocator.cc:47] Overriding orig_value setting because the TF_FORCE_GPU_ALLOW_GROWTH environment variable is set. Original config value was 0.","time":"2023-08-21T05:59:35.390Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"2023-08-21 05:59:35.390622: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1639] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 13692 MB memory:  -> device: 0, name: Tesla T4, pci bus id: 0000:00:04.0, compute capability: 7.5","time":"2023-08-21T05:59:35.390Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"2023-08-21 05:59:39.054266: I tensorflow/compiler/xla/stream_executor/cuda/cuda_dnn.cc:432] Loaded cuDNN version 8900","time":"2023-08-21T05:59:39.054Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"2023-08-21 05:59:39.054436: F tensorflow/compiler/xla/stream_executor/cuda/cuda_dnn.cc:983] Check failed: cudnnSetPoolingNdDescriptor( handle_.get(), (pooling_descriptor.mode() == dnn::PoolingMode::kMaximum ? cudnn_max_pooling_mode : CUDNN_POOLING_AVERAGE_COUNT_EXCLUDE_PADDING), propagate_nans ? CUDNN_PROPAGATE_NAN : CUDNN_NOT_PROPAGATE_NAN, nd, shape.data(), padding.data(), strides.data()) == CUDNN_STATUS_SUCCESS (3 vs. 0)","time":"2023-08-21T05:59:39.055Z","v":0}
{"pid":7,"type":"jupyter","level":30,"msg":"KernelRestarter: restarting kernel (1/5), keep random ports","time":"2023-08-21T05:59:41.410Z","v":0}
{"pid":7,"type":"jupyter","level":40,"msg":"WARNING:root:kernel 7be3ebb5-8079-41dd-a058-72f1e271f55f restarted","time":"2023-08-21T05:59:41.410Z","v":0}
``` @dmc1778 That's an error that is being returned to the user instead of performing bad computations.
Could you please report this in the proper channel as mentioned [here](https://github.com/tensorflow/tensorflow/blob/master/SECURITY.md). Thank you! @sushreebarsa , in the [last error log](https://github.com/tensorflow/tensorflow/issues/61643#issuecomment-1685700653) there is a CHECK failure, not an error that is being returned to the user.

The difference is that an error being returned to the user could be caught in a `try`-`catch`, would not crash the Python interpreter, etc, whereas the `CHECK` failure could result in a denial of service (which does not constitute a significant security issue, though it should be fixed) Hi @dmc1778 ,

I have replicated the error with **GPU** environment. The behaviour is random. At first run the execution is success and when rerun it got the **CUDA_ERROR_ILLEGAL_ADDRESS** below.

`E tensorflow/compiler/xla/stream_executor/cuda/cuda_event.cc:29] Error polling for event status: failed to query event: CUDA_ERROR_ILLEGAL_ADDRESS: an illegal memory access was encountered`

Attached screenshot below for same. This needs to be fixed.


<img width="1508" alt="Screenshot 2023-08-23 at 5 34 45 PM" src="https://github.com/tensorflow/tensorflow/assets/116063290/b58454d4-3303-4fd4-9481-13d73c5c8c26">

### Issue type

Bug

### Have you reproduced the bug with TensorFlow Nightly?

No

### Source

binary

### TensorFlow version

2.13.0

### Custom code

Yes

### OS platform and distribution

_No response_

### Mobile device

_No response_

### Python version

_No response_

### Bazel version

_No response_

### GCC/compiler version

_No response_

### CUDA/cuDNN version

_No response_

### GPU model and memory

_No response_

### Current behavior?

Due to a very large integer variable as input to the API

### Standalone code to reproduce the issue

```shell
import tensorflow as tf
import os
import numpy as np
try:
  n = 1152921504606846975
  arg_class = tf.keras.layers.RepeatVector(n=n,)
  arg_input_0_tensor = tf.random.uniform([2, 2], dtype=tf.float32)
  arg_input_0 = tf.identity(arg_input_0_tensor)
  arg_input = [arg_input_0,]
  out = arg_class(*arg_input)
except Exception as e:
  print("Error:"+str(e))

```
```


### Relevant log output

```shell
023-08-18 22:31:57.943444: I tensorflow/core/platform/cpu_feature_guard.cc:182] This TensorFlow binary is optimized to use available CPU instructions in performance-critical operations.
To enable the following instructions: AVX2 FMA, in other operations, rebuild TensorFlow with the appropriate compiler flags.
2023-08-18 22:31:58.502559: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Could not find TensorRT
2023-08-18 22:31:58.969005: I tensorflow/compiler/xla/stream_executor/cuda/cuda_gpu_executor.cc:995] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero. See more at https://github.com/torvalds/linux/blob/v6.0/Documentation/ABI/testing/sysfs-bus-pci#L344-L355
2023-08-18 22:31:58.987690: I tensorflow/compiler/xla/stream_executor/cuda/cuda_gpu_executor.cc:995] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero. See more at https://github.com/torvalds/linux/blob/v6.0/Documentation/ABI/testing/sysfs-bus-pci#L344-L355
2023-08-18 22:31:58.987833: I tensorflow/compiler/xla/stream_executor/cuda/cuda_gpu_executor.cc:995] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero. See more at https://github.com/torvalds/linux/blob/v6.0/Documentation/ABI/testing/sysfs-bus-pci#L344-L355
2023-08-18 22:31:58.989274: I tensorflow/compiler/xla/stream_executor/cuda/cuda_gpu_executor.cc:995] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero. See more at https://github.com/torvalds/linux/blob/v6.0/Documentation/ABI/testing/sysfs-bus-pci#L344-L355
2023-08-18 22:31:58.989436: I tensorflow/compiler/xla/stream_executor/cuda/cuda_gpu_executor.cc:995] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero. See more at https://github.com/torvalds/linux/blob/v6.0/Documentation/ABI/testing/sysfs-bus-pci#L344-L355
2023-08-18 22:31:58.989557: I tensorflow/compiler/xla/stream_executor/cuda/cuda_gpu_executor.cc:995] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero. See more at https://github.com/torvalds/linux/blob/v6.0/Documentation/ABI/testing/sysfs-bus-pci#L344-L355
2023-08-18 22:31:59.044537: I tensorflow/compiler/xla/stream_executor/cuda/cuda_gpu_executor.cc:995] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero. See more at https://github.com/torvalds/linux/blob/v6.0/Documentation/ABI/testing/sysfs-bus-pci#L344-L355
2023-08-18 22:31:59.044666: I tensorflow/compiler/xla/stream_executor/cuda/cuda_gpu_executor.cc:995] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero. See more at https://github.com/torvalds/linux/blob/v6.0/Documentation/ABI/testing/sysfs-bus-pci#L344-L355
2023-08-18 22:31:59.044756: I tensorflow/compiler/xla/stream_executor/cuda/cuda_gpu_executor.cc:995] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero. See more at https://github.com/torvalds/linux/blob/v6.0/Documentation/ABI/testing/sysfs-bus-pci#L344-L355
2023-08-18 22:31:59.044834: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1639] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 4249 MB memory:  -> device: 0, name: NVIDIA GeForce GTX 1660 Ti, pci bus id: 0000:01:00.0, compute capability: 7.5
{}
2023-08-18 22:31:59.138979: F tensorflow/tsl/framework/bfc_allocator.cc:797] Check failed: c->in_use() && (c->bin_num == kInvalidBinNum) 
Aborted

```
```
