[ROCm] Support of hipblaslt
@akuegel would you review our hipblas_lt PR, please? Thanks in advance! @ekuznetsov139 Not sure whether you saw my review comments? I got asked by @i-chaochen about this PR, but I think this now needs the changes from your side until I can approve it. > @ekuznetsov139 Not sure whether you saw my review comments? I got asked by @i-chaochen about this PR, but I think this now needs the changes from your side until I can approve it.

Hi @akuegel  Thanks for the feedback. I am going to split this big PR to smaller ones due to some upstream changes. And I will do the changes based on your feedback as well.

We're going to push it to XLA first (https://github.com/openxla/xla/pull/3953). Thanks in advance! Hi @ekuznetsov139 Can you please rebase your branch and resolve conflicts? Thank you! This PR is stale because it has been open for 14 days with no activity. It will be closed if no further activity occurs. Thank you. This PR was closed because it has been inactive for 14 days since being marked as stale. Please reopen if you'd like to work on this further.
This PR:

* Enables detection of hipblaslt. Hooks it up in place of cublaslt when available. 

* Enables the _FusedMatMul op for ROCm and routes it to hipblaslt. 

* Fixes certain #includes due to their deprecation in ROCm 5.6.