Model train failing
@chrisvdt Could you please upgrade to the latest TF version 2.13 as the older versions are not actively supported. I was able to run the code successfully using TF v2.13 . Please find the gist [here](https://colab.research.google.com/gist/sushreebarsa/e914f851201383d0d71d8bc556bebbc4/advanced.ipynb#scrollTo=nOOLr8yP4h6Z) and confirm the same. Thank you! @sushreebarsa Yes I can confirm that it works now.
I only realized later that I had to exactly follow the instructions on this page :
https://www.tensorflow.org/install/pip#step-by-step_instructions

thanks Are you satisfied with the resolution of your issue?
<a href="https://docs.google.com/forms/d/e/1FAIpQLSfaP12TRhd9xSxjXZjcZFNXPGk4kc1-qMdv3gc6bEP90vY1ew/viewform?entry.85265664=Yes&entry.2137816233=https://github.com/tensorflow/tensorflow/issues/61832">Yes</a>
<a href="https://docs.google.com/forms/d/e/1FAIpQLSfaP12TRhd9xSxjXZjcZFNXPGk4kc1-qMdv3gc6bEP90vY1ew/viewform?entry.85265664=No&entry.2137816233=https://github.com/tensorflow/tensorflow/issues/61832">No</a>

### Issue type

Performance

### Have you reproduced the bug with TensorFlow Nightly?

No

### Source

binary

### TensorFlow version

2.4.1

### Custom code

No

### OS platform and distribution

Windows 11 WSL Ubuntu 20.04.6 LTS

### Mobile device

_No response_

### Python version

3.9.17

### Bazel version

_No response_

### GCC/compiler version

_No response_

### CUDA/cuDNN version

Cudatoolkit 10.1.234 Cudann 7.6.5

### GPU model and memory

NVIDIA GeForce RTX 4080 deviceMemorySize: 15.99GiB

### Current behavior?

Running : jupyter notebook: TensorFlow 2 quickstart for experts
https://www.tensorflow.org/tutorials/quickstart/advanced

2023-09-08 23:55:01.853625: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:01:00.0 name: NVIDIA GeForce RTX 4080 computeCapability: 8.9
coreClock: 2.505GHz coreCount: 76 deviceMemorySize: 15.99GiB deviceMemoryBandwidth: 667.63GiB/s


TRAINING THE MODEL:

2023-09-09 14:21:13.106797: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:116] None of the MLIR optimization passes are enabled (registered 2)
2023-09-09 14:21:13.108589: I tensorflow/core/platform/profile_utils/cpu_utils.cc:112] CPU Frequency: 3417595000 Hz
2023-09-09 14:21:13.135568: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.10
2023-09-09 14:22:05.711952: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.7

NOT LEARNING!!!
Epoch 14, Loss: 2.3014447689056396, Accuracy: 11.233333587646484, Test Loss: 2.3011932373046875, Test Accuracy: 11.34000015258789
Epoch 15, Loss: 2.301426410675049, Accuracy: 11.236666679382324, Test Loss: 2.3012006282806396, Test Accuracy: 11.329999923706055



### Standalone code to reproduce the issue

```shell
https://www.tensorflow.org/tutorials/quickstart/advanced
```


### Relevant log output

_No response_