[ROCm] Performance optimization on rocBLAS broadcasting
Hi @jurahul Can you please review this PR ? Thank you! Hi @jurahul Can you please review this PR ? Thank you! Hi @cheshire sorry to ping you again, because this PR is pending too long and it's caused conflict after you approved. So I resolved it, which means it needs you approve again.


Performance optimization on rocBLAS broadcasting based on fold and fp32 kernel, this has existed in our repo for a long time and we hope it can sync with upstream. 

Thanks in advance! @cheshire 