Model profile for inference
Hi **@akote123** 
To get operation-level timings or execution time of specific operations within a graph, you can use the TensorFlow Profiler tool. I attached a [gist](https://colab.research.google.com/gist/Venkat6871/0a522038d4ff7e056d7cdb57cd33d884/62329.ipynb) for your reference.

Thank you! @Venkat6871 , can please provide access to gist
 **@akote123**  Thanks for your response!
Could you check the gist now. I hope it will run.

Thank you! Hi @Venkat6871 ,
     I tired with gist , but I am not able to see data in tensorboard.

`tf.profiler.experimental.start('logs')
     
 output = model.predict(encoded_input, verbose=False)[0]
   tf.profiler.experimental.stop()`

This way I tried. Please let me know if I need to do change  Hi **@akote123**  Thanks for your response!
Actually I just send enable profiling. Here we need to follow some steps.
1.Enable profiling after this step.
2.Running Tensorboard:
After executing your Python script that includes the profiling code, you need to run TensorBoard to visualize the collected profiling data.
Open your terminal or command prompt and use the following command:
```
tensorboard --logdir=logs
```
3.Accessing Tensorboard:
 After you run the command, open a web browser and go to the address shown in the terminal where TensorBoard is running.
 @Venkat6871 , I actually followed all the steps and when teansorboard is opened in web , In the profile tab when click for op level , the page is showing empty. @Venkat6871 , is there any other way I can get profile data for inference
 @SuryanarayanaY , For the above code I get tensorboard as attached
<img width="926" alt="tensorboard" src="https://github.com/tensorflow/tensorflow/assets/133775732/6aaf35fc-206e-43bd-992b-d60ebb44141a">
 Hi @akote123 ,

Please refer to this [tutorial](https://www.tensorflow.org/tensorboard/tensorboard_profiling_keras) for profiling with tensorboard. Also check this tutorial to use [Tesorboard](https://www.tensorflow.org/tensorboard/tensorboard_in_notebooks) in notebokks itself. This issue is stale because it has been open for 7 days with no activity. It will be closed if no further activity occurs. Thank you. @SuryanarayanaY , @Venkat6871 I able to get tensorboard results when I downgraded protobuf to 3.X but when try to use the same for transfomer model the tensorboard is showing empty again.
`tf.profiler.experimental.start('logs1')
logits = model(**inputs)
tf.profiler.experimental.stop()`
Hi,
   For inference how we can get op level timings in tensorflow


Thanks