Is DTensor compatible with Horovod
@dengpanyin,
Could you please provide some more information/usecase on the above ask, it helps us to analyse the issue in an effective way. 

Also please refer to the document, where it was mentioned that to use the Horovod with TensorFlow, please try to make the modifications to your training script which are mentioned.
https://horovod.readthedocs.io/en/stable/tensorflow.html

Thank you! This issue is stale because it has been open for 7 days with no activity. It will be closed if no further activity occurs. Thank you. Closing this as stale. Please reopen if this is still a valid request. Thank you! Are you satisfied with the resolution of your issue?
<a href="https://docs.google.com/forms/d/e/1FAIpQLSfaP12TRhd9xSxjXZjcZFNXPGk4kc1-qMdv3gc6bEP90vY1ew/viewform?entry.85265664=Yes&entry.2137816233=https://github.com/tensorflow/tensorflow/issues/60505">Yes</a>
<a href="https://docs.google.com/forms/d/e/1FAIpQLSfaP12TRhd9xSxjXZjcZFNXPGk4kc1-qMdv3gc6bEP90vY1ew/viewform?entry.85265664=No&entry.2137816233=https://github.com/tensorflow/tensorflow/issues/60505">No</a>

<details><summary>Click to expand!</summary> 
 
 ### Issue Type

Support

### Have you reproduced the bug with TF nightly?

Yes

### Source

source

### Tensorflow Version

2.12

### Custom Code

Yes

### OS Platform and Distribution

_No response_

### Mobile device

_No response_

### Python version

_No response_

### Bazel version

_No response_

### GCC/Compiler version

_No response_

### CUDA/cuDNN version

_No response_

### GPU model and memory

_No response_

### Current Behaviour?

Want to check if DTensor model parallel compatible with Horovod? Any code examples or Benchmark of DTensor model parallel? 

### Standalone code to reproduce the issue

```shell
NA
```


### Relevant log output

_No response_</details>