[ROCM] Reland of PR #57102
Thanks for your pull request! It looks like this may be your first contribution to a Google open source project. Before we can look at your pull request, you'll need to sign a Contributor License Agreement (CLA).

View this [failed invocation](https://github.com/tensorflow/tensorflow/pull/60433/checks?check_run_id=13102471126) of the CLA check for more information.

For the most up to date status, view the checks section at the bottom of the pull request. Hi @draganmladjenovic Can you please sign CLA. Thank you!
 @gbaned rocm CI build dosn't seem to be related to this PR?
EDIT: Another question. What to do with changes that touch upon the XLA? I heard suggestion that they should go trough openXLA repo. Is this correct? Hi @cheshire Can you please assist on above comments from @draganmladjenovic. Thank you! Hi @akuegel wonder will you review this PR, please? Thanks in advance!
       Wire up TrsmBatched and Gesvd and add Trsv