build tensorflow v2.15.0 failed
@fancyerii,
Could you please let us know that there is any specific reason to use cuda-**11.8** with tensorflow **2.15**.  The latest tensorflow v2.15 is compatible with the CUDA 12.2 which might be the reason. Could you please try to follow the tested build configurations from the official document for the smooth installation.
https://www.tensorflow.org/install/source#gpu

`cp -r clang+llvm-16.0.0-x86_64-linux-gnu-ubuntu-18.04/* /usr`

Thank you!

 I just don't want to install many versions of cuda. I tried to v2.14.0, and it worked. Maybe I should use docker to avoid install cuda. Are you satisfied with the resolution of your issue?
<a href="https://docs.google.com/forms/d/e/1FAIpQLSfaP12TRhd9xSxjXZjcZFNXPGk4kc1-qMdv3gc6bEP90vY1ew/viewform?entry.85265664=Yes&entry.2137816233=https://github.com/tensorflow/tensorflow/issues/62974">Yes</a>
<a href="https://docs.google.com/forms/d/e/1FAIpQLSfaP12TRhd9xSxjXZjcZFNXPGk4kc1-qMdv3gc6bEP90vY1ew/viewform?entry.85265664=No&entry.2137816233=https://github.com/tensorflow/tensorflow/issues/62974">No</a>

### Issue type

Bug

### Have you reproduced the bug with TensorFlow Nightly?

No

### Source

source

### TensorFlow version

2.15.0

### Custom code

No

### OS platform and distribution

ubuntu 18.04

### Mobile device

_No response_

### Python version

3.9

### Bazel version

6.1.0

### GCC/compiler version

_No response_

### CUDA/cuDNN version

_No response_

### GPU model and memory

_No response_

### Current behavior?

can't build


### Standalone code to reproduce the issue

```shell
I want to build tensorflow v2.15.0 with cuda-11.8, cudnn 8.9 and tensorrt 8.6 in ubuntu 16.04.
1. configure

$ ./configure
You have bazel 6.1.0 installed.
Please specify the location of python. [Default is /nas/lili/codes/pt/tf/buildvenv/bin/python3]:


Found possible Python library paths:
  /nas/lili/codes/pt/tf/buildvenv/lib/python3.9/site-packages
Please input the desired Python library path to use.  Default is [/nas/lili/codes/pt/tf/buildvenv/lib/python3.9/site-packages]

Do you wish to build TensorFlow with ROCm support? [y/N]: n
No ROCm support will be enabled for TensorFlow.

Do you wish to build TensorFlow with CUDA support? [y/N]: y
CUDA support will be enabled for TensorFlow.

Do you wish to build TensorFlow with TensorRT support? [y/N]: y
TensorRT support will be enabled for TensorFlow.

Found CUDA 11.8 in:
    /usr/local/cuda-11.8/targets/x86_64-linux/lib
    /usr/local/cuda-11.8/targets/x86_64-linux/include
Found cuDNN 8 in:
    /usr/local/cuda-11.8/targets/x86_64-linux/lib
    /usr/local/cuda-11.8/targets/x86_64-linux/include
Found TensorRT 8.6.1 in:
    /home/ubuntu/TensorRT-8.6.1.6/targets/x86_64-linux-gnu/lib
    /home/ubuntu/TensorRT-8.6.1.6/include
Please specify a list of comma-separated CUDA compute capabilities you want to build with.
You can find the compute capability of your device at: https://developer.nvidia.com/cuda-gpus. Each capability can be specified as "x.y" or "compute_xy" to include both virtual and binary GPU code, or as "sm_xy" to only include the binary code.
Please note that each additional compute capability significantly increases your build time and binary size, and that TensorFlow only supports compute capabilities >= 3.5 [Default is: 3.5,7.0]:


Do you want to use clang as CUDA compiler? [Y/n]: y
Clang will be used as CUDA compiler.

Please specify clang path that to be used as host compiler. [Default is /usr/local/bin/clang]:


You have Clang 16.0.0 installed.

Please specify optimization flags to use during compilation when bazel option "--config=opt" is specified [Default is -Wno-sign-compare]:


Would you like to interactively configure ./WORKSPACE for Android builds? [y/N]: n
Not configuring the WORKSPACE for Android builds.

Preconfigured Bazel build configs. You can use any of the below by adding "--config=<>" to your build command. See .bazelrc for more details.
        --config=mkl            # Build with MKL support.
        --config=mkl_aarch64    # Build with oneDNN and Compute Library for the Arm Architecture (ACL).
        --config=monolithic     # Config for mostly static monolithic build.
        --config=numa           # Build with NUMA support.
        --config=dynamic_kernels        # (Experimental) Build kernels into separate shared objects.
        --config=v1             # Build with TensorFlow 1 API instead of TF 2 API.
Preconfigured Bazel build configs to DISABLE default on features:   
        --config=nogcp          # Disable GCP support.
        --config=nonccl         # Disable NVIDIA NCCL support.
Configuration finished

```

2. build
```
$ bazel build //tensorflow/tools/pip_package:build_pip_package
Starting local Bazel server and connecting to it...
WARNING: The following configs were expanded more than once: [tensorrt, cuda_clang, cuda]. For repeatable flags, repeats are counted twice and may lead to unexpected behavior.
INFO: Reading 'startup' options from /nas/lili/codes/pt/tf/tensorflow/.bazelrc: --windows_enable_symlinks
INFO: Options provided by the client:
  Inherited 'common' options: --isatty=1 --terminal_columns=141
INFO: Reading rc options for 'build' from /nas/lili/codes/pt/tf/tensorflow/.bazelrc:
  Inherited 'common' options: --experimental_repo_remote_exec
INFO: Reading rc options for 'build' from /nas/lili/codes/pt/tf/tensorflow/.bazelrc:
  'build' options: --define framework_shared_object=true --define tsl_protobuf_header_only=true --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --noincompatible_remove_legacy_whole_archive --features=-force_no_whole_archive --enable_platform_specific_config --define=with_xla_support=true --config=short_logs --config=v2 --define=no_aws_support=true --define=no_hdfs_support=true --experimental_cc_shared_library --experimental_link_static_libraries_once=false --incompatible_enforce_config_setting_visibility
INFO: Reading rc options for 'build' from /nas/lili/codes/pt/tf/tensorflow/.tf_configure.bazelrc:
  'build' options: --action_env PYTHON_BIN_PATH=/nas/lili/codes/pt/tf/buildvenv/bin/python3 --action_env PYTHON_LIB_PATH=/nas/lili/codes/pt/tf/buildvenv/lib/python3.9/site-packages --python_path=/nas/lili/codes/pt/tf/buildvenv/bin/python3 --config=tensorrt --action_env TF_CUDA_PATHS=/usr/local/cuda-11.8 --action_env CUDA_TOOLKIT_PATH=/usr/local/cuda-11.8 --action_env TENSORRT_INSTALL_PATH=/home/ubuntu/TensorRT-8.6.1.6 --action_env TF_CUDA_COMPUTE_CAPABILITIES=3.5,7.0 --action_env LD_LIBRARY_PATH=/usr/local/cuda-11.8/lib64 --config=cuda_clang --action_env CLANG_CUDA_COMPILER_PATH=/usr/local/bin/clang-16 --copt=-Wno-gnu-offsetof-extensions --config=cuda_clang
INFO: Found applicable config definition build:short_logs in file /nas/lili/codes/pt/tf/tensorflow/.bazelrc: --output_filter=DONT_MATCH_ANYTHING
INFO: Found applicable config definition build:v2 in file /nas/lili/codes/pt/tf/tensorflow/.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1
INFO: Found applicable config definition build:tensorrt in file /nas/lili/codes/pt/tf/tensorflow/.bazelrc: --repo_env TF_NEED_TENSORRT=1
INFO: Found applicable config definition build:cuda_clang in file /nas/lili/codes/pt/tf/tensorflow/.bazelrc: --config=cuda --config=tensorrt --action_env=TF_CUDA_CLANG=1 --@local_config_cuda//:cuda_compiler=clang --repo_env=TF_CUDA_COMPUTE_CAPABILITIES=sm_50,sm_60,sm_70,sm_75,compute_80
INFO: Found applicable config definition build:cuda in file /nas/lili/codes/pt/tf/tensorflow/.bazelrc: --repo_env TF_NEED_CUDA=1 --crosstool_top=@local_config_cuda//crosstool:toolchain --@local_config_cuda//:enable_cuda
INFO: Found applicable config definition build:tensorrt in file /nas/lili/codes/pt/tf/tensorflow/.bazelrc: --repo_env TF_NEED_TENSORRT=1
INFO: Found applicable config definition build:cuda_clang in file /nas/lili/codes/pt/tf/tensorflow/.bazelrc: --config=cuda --config=tensorrt --action_env=TF_CUDA_CLANG=1 --@local_config_cuda//:cuda_compiler=clang --repo_env=TF_CUDA_COMPUTE_CAPABILITIES=sm_50,sm_60,sm_70,sm_75,compu
te_80
INFO: Found applicable config definition build:cuda in file /nas/lili/codes/pt/tf/tensorflow/.bazelrc: --repo_env TF_NEED_CUDA=1 --crosstool_top=@local_config_cuda//crosstool:toolchain --@local_config_cuda//:enable_cuda
INFO: Found applicable config definition build:tensorrt in file /nas/lili/codes/pt/tf/tensorflow/.bazelrc: --repo_env TF_NEED_TENSORRT=1
INFO: Found applicable config definition build:linux in file /nas/lili/codes/pt/tf/tensorflow/.bazelrc: --host_copt=-w --copt=-Wno-all --copt=-Wno-extra --copt=-Wno-deprecated --copt=-Wno-deprecated-declarations --copt=-Wno-ignored-attributes --copt=-Wno-array-bounds --copt=-Wunused-result --copt=-Werror=unused-result --copt=-Wswitch --copt=-Werror=switch --copt=-Wno-error=unused-but-set-variable --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --define=PROTOBUF_INCLUDE_PATH=$(PREFIX)/include --cxxopt=-std=c++17 --host_cxxopt=-std=c++17 --config=dynamic_kernels --experimental_guard_against_concurrent_changes
INFO: Found applicable config definition build:dynamic_kernels in file /nas/lili/codes/pt/tf/tensorflow/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS
WARNING: The following configs were expanded more than once: [tensorrt, cuda_clang, cuda]. For repeatable flags, repeats are counted twice and may lead to unexpected behavior.
INFO: Analyzed target //tensorflow/tools/pip_package:build_pip_package (701 packages loaded, 49740 targets configured).
INFO: Found 1 target...
[32,640 / 32,707] 2 actions running
ERROR: /nas/lili/codes/pt/tf/tensorflow/tensorflow/BUILD:1301:21: Linking tensorflow/libtensorflow_cc.so.2.15.0 failed: (Exit 1): clang-16 failed: error executing command (from target //tensorflow:libtensorflow_cc.so.2.15.0) /usr/local/bin/clang-16 @bazel-out/k8-opt/bin/tensorflow/libtensorflow_cc.so.2.15.0-2.params
bazel-out/k8-opt/bin/tensorflow/core/kernels/sparse/libkernels.pic.lo(sparse_mat_mul_op.pic.o): In function `tensorflow::CSRSparseMatMulGPUOp<Eigen::GpuDevice, float>::Compute(tensorflow::OpKernelContext*)':  
sparse_mat_mul_op.cc:(.text._ZN10tensorflow20CSRSparseMatMulGPUOpIN5Eigen9GpuDeviceEfE7ComputeEPNS_15OpKernelContextE[_ZN10tensorflow20CSRSparseMatMulGPUOpIN5Eigen9GpuDeviceEfE7ComputeEPNS_15OpKernelContextE]+0x11d0): undefined reference to `cusparseDestroyCsrgemm2Info'
bazel-out/k8-opt/bin/tensorflow/core/kernels/sparse/libkernels.pic.lo(sparse_mat_mul_op.pic.o): In function `tensorflow::functor::CSRSparseSparseMatrixMatMul<Eigen::GpuDevice, float>::Initialize()':
sparse_mat_mul_op.cc:(.text._ZN10tensorflow7functor27CSRSparseSparseMatrixMatMulIN5Eigen9GpuDeviceEfE10InitializeEv[_ZN10tensorflow7functor27CSRSparseSparseMatrixMatMulIN5Eigen9GpuDeviceEfE10InitializeEv]+0x104): undefined reference to `cusparseCreateCsrgemm2Info'
bazel-out/k8-opt/bin/tensorflow/core/kernels/sparse/libkernels.pic.lo(sparse_mat_mul_op.pic.o): In function `tensorflow::functor::CSRSparseSparseMatrixMatMul<Eigen::GpuDevice, float>::~CSRSparseSparseMatrixMatMul()':
sparse_mat_mul_op.cc:(.text._ZN10tensorflow7functor27CSRSparseSparseMatrixMatMulIN5Eigen9GpuDeviceEfED2Ev[_ZN10tensorflow7functor27CSRSparseSparseMatrixMatMulIN5Eigen9GpuDeviceEfED2Ev]+0x22): undefined reference to `cusparseDestroyCsrgemm2Info'
bazel-out/k8-opt/bin/tensorflow/core/kernels/sparse/libkernels.pic.lo(sparse_mat_mul_op.pic.o): In function `tensorflow::functor::CSRSparseSparseMatrixMatMul<Eigen::GpuDevice, float>::~CSRSparseSparseMatrixMatMul()':
sparse_mat_mul_op.cc:(.text._ZN10tensorflow7functor27CSRSparseSparseMatrixMatMulIN5Eigen9GpuDeviceEfED0Ev[_ZN10tensorflow7functor27CSRSparseSparseMatrixMatMulIN5Eigen9GpuDeviceEfED0Ev]+0x22): undefined reference to `cusparseDestroyCsrgemm2Info'
bazel-out/k8-opt/bin/tensorflow/core/kernels/sparse/libkernels.pic.lo(sparse_mat_mul_op.pic.o): In function `tensorflow::CSRSparseMatMulGPUOp<Eigen::GpuDevice, double>::Compute(tensorflow::OpKernelContext*)': 
sparse_mat_mul_op.cc:(.text._ZN10tensorflow20CSRSparseMatMulGPUOpIN5Eigen9GpuDeviceEdE7ComputeEPNS_15OpKernelContextE[_ZN10tensorflow20CSRSparseMatMulGPUOpIN5Eigen9GpuDeviceEdE7ComputeEPNS_15OpKernelContextE]+0x11d0): undefined reference to `cusparseDestroyCsrgemm2Info'
bazel-out/k8-opt/bin/tensorflow/core/kernels/sparse/libkernels.pic.lo(sparse_mat_mul_op.pic.o): In function `tensorflow::functor::CSRSparseSparseMatrixMatMul<Eigen::GpuDevice, double>::Initialize()':
sparse_mat_mul_op.cc:(.text._ZN10tensorflow7functor27CSRSparseSparseMatrixMatMulIN5Eigen9GpuDeviceEdE10InitializeEv[_ZN10tensorflow7functor27CSRSparseSparseMatrixMatMulIN5Eigen9GpuDeviceEdE10InitializeEv]+0x104): undefined reference to `cusparseCreateCsrgemm2Info'
bazel-out/k8-opt/bin/tensorflow/core/kernels/sparse/libkernels.pic.lo(sparse_mat_mul_op.pic.o): In function `tensorflow::functor::CSRSparseSparseMatrixMatMul<Eigen::GpuDevice, double>::~CSRSparseSparseMatrixMatMul()':
sparse_mat_mul_op.cc:(.text._ZN10tensorflow7functor27CSRSparseSparseMatrixMatMulIN5Eigen9GpuDeviceEdED2Ev[_ZN10tensorflow7functor27CSRSparseSparseMatrixMatMulIN5Eigen9GpuDeviceEdED2Ev]+0x22): undefined reference to `cusparseDestroyCsrgemm2Info'
bazel-out/k8-opt/bin/tensorflow/core/kernels/sparse/libkernels.pic.lo(sparse_mat_mul_op.pic.o): In function `tensorflow::functor::CSRSparseSparseMatrixMatMul<Eigen::GpuDevice, double>::~CSRSparseSparseMatrixMatMul()':
sparse_mat_mul_op.cc:(.text._ZN10tensorflow7functor27CSRSparseSparseMatrixMatMulIN5Eigen9GpuDeviceEdED0Ev[_ZN10tensorflow7functor27CSRSparseSparseMatrixMatMulIN5Eigen9GpuDeviceEdED0Ev]+0x22): undefined reference to `cusparseDestroyCsrgemm2Info'
bazel-out/k8-opt/bin/tensorflow/core/kernels/sparse/libkernels.pic.lo(sparse_mat_mul_op.pic.o): In function `tensorflow::CSRSparseMatMulGPUOp<Eigen::GpuDevice, std::complex<float> >::Compute(tensorflow::OpKernelContext*)':
sparse_mat_mul_op.cc:(.text._ZN10tensorflow20CSRSparseMatMulGPUOpIN5Eigen9GpuDeviceESt7complexIfEE7ComputeEPNS_15OpKernelContextE[_ZN10tensorflow20CSRSparseMatMulGPUOpIN5Eigen9GpuDeviceESt7complexIfEE7ComputeEPNS_15OpKernelContextE]+0x11d0): undefined reference to `cusparseDestroyCsrgemm2Info'
bazel-out/k8-opt/bin/tensorflow/core/kernels/sparse/libkernels.pic.lo(sparse_mat_mul_op.pic.o): In function `tensorflow::functor::CSRSparseSparseMatrixMatMul<Eigen::GpuDevice, std::complex<float> >::Initialize()':
sparse_mat_mul_op.cc:(.text._ZN10tensorflow7functor27CSRSparseSparseMatrixMatMulIN5Eigen9GpuDeviceESt7complexIfEE10InitializeEv[_ZN10tensorflow7functor27CSRSparseSparseMatrixMatMulIN5Eigen9GpuDeviceESt7complexIfEE10InitializeEv]+0x104): undefined reference to `cusparseCreateCsrgemm2Info'
bazel-out/k8-opt/bin/tensorflow/core/kernels/sparse/libkernels.pic.lo(sparse_mat_mul_op.pic.o): In function `tensorflow::functor::CSRSparseSparseMatrixMatMul<Eigen::GpuDevice, std::complex<float> >::~CSRSparseSparseMatrixMatMul()':
sparse_mat_mul_op.cc:(.text._ZN10tensorflow7functor27CSRSparseSparseMatrixMatMulIN5Eigen9GpuDeviceESt7complexIfEED2Ev[_ZN10tensorflow7functor27CSRSparseSparseMatrixMatMulIN5Eigen9GpuDeviceESt7complexIfEED2Ev]+0x22): undefined reference to `cusparseDestroyCsrgemm2Info'
bazel-out/k8-opt/bin/tensorflow/core/kernels/sparse/libkernels.pic.lo(sparse_mat_mul_op.pic.o): In function `tensorflow::functor::CSRSparseSparseMatrixMatMul<Eigen::GpuDevice, std::complex<float> >::~CSRSparseSparseMatrixMatMul()':
sparse_mat_mul_op.cc:(.text._ZN10tensorflow7functor27CSRSparseSparseMatrixMatMulIN5Eigen9GpuDeviceESt7complexIfEED0Ev[_ZN10tensorflow7functor27CSRSparseSparseMatrixMatMulIN5Eigen9GpuDeviceESt7complexIfEED0Ev]+0x22): undefined reference to `cusparseDestroyCsrgemm2Info'
bazel-out/k8-opt/bin/tensorflow/core/kernels/sparse/libkernels.pic.lo(sparse_mat_mul_op.pic.o): In function `tensorflow::CSRSparseMatMulGPUOp<Eigen::GpuDevice, std::complex<double> >::Compute(tensorflow::OpKernelContext*)':
sparse_mat_mul_op.cc:(.text._ZN10tensorflow20CSRSparseMatMulGPUOpIN5Eigen9GpuDeviceESt7complexIdEE7ComputeEPNS_15OpKernelContextE[_ZN10tensorflow20CSRSparseMatMulGPUOpIN5Eigen9GpuDeviceESt7complexIdEE7ComputeEPNS_15OpKernelContextE]+0x11d7): undefined reference to `cusparseDestroyCsrgemm2Info'
bazel-out/k8-opt/bin/tensorflow/core/kernels/sparse/libkernels.pic.lo(sparse_mat_mul_op.pic.o): In function `tensorflow::functor::CSRSparseSparseMatrixMatMul<Eigen::GpuDevice, std::complex<double> >::Initialize()':
sparse_mat_mul_op.cc:(.text._ZN10tensorflow7functor27CSRSparseSparseMatrixMatMulIN5Eigen9GpuDeviceESt7complexIdEE10InitializeEv[_ZN10tensorflow7functor27CSRSparseSparseMatrixMatMulIN5Eigen9GpuDeviceESt7complexIdEE10InitializeEv]+0x104): undefined reference to `cusparseCreateCsrgemm2Info'
bazel-out/k8-opt/bin/tensorflow/core/kernels/sparse/libkernels.pic.lo(sparse_mat_mul_op.pic.o): In function `tensorflow::functor::CSRSparseSparseMatrixMatMul<Eigen::GpuDevice, std::complex<double> >::~CSRSparseSparseMatrixMatMul()':
sparse_mat_mul_op.cc:(.text._ZN10tensorflow7functor27CSRSparseSparseMatrixMatMulIN5Eigen9GpuDeviceESt7complexIdEED2Ev[_ZN10tensorflow7functor27CSRSparseSparseMatrixMatMulIN5Eigen9GpuDeviceESt7complexIdEED2Ev]+0x22): undefined reference to `cusparseDestroyCsrgemm2Info'
bazel-out/k8-opt/bin/tensorflow/core/kernels/sparse/libkernels.pic.lo(sparse_mat_mul_op.pic.o): In function `tensorflow::functor::CSRSparseSparseMatrixMatMul<Eigen::GpuDevice, std::complex<double> >::~CSRSparseSparseMatrixMatMul()':
sparse_mat_mul_op.cc:(.text._ZN10tensorflow7functor27CSRSparseSparseMatrixMatMulIN5Eigen9GpuDeviceESt7complexIdEED0Ev[_ZN10tensorflow7functor27CSRSparseSparseMatrixMatMulIN5Eigen9GpuDeviceESt7complexIdEED0Ev]+0x22): undefined reference to `cusparseDestroyCsrgemm2Info'
bazel-out/k8-opt/bin/tensorflow/core/util/libcuda_sparse.pic.lo(cuda_sparse.pic.o): In function `absl::lts_20230125::Status tensorflow::GpuSparse::Csrmv<float>(cusparseOperation_t, int, int, int, float const*, float const*, int const*, int const*, float const*, float const*, float*) const':
cuda_sparse.cc:(.text._ZNK10tensorflow9GpuSparse5CsrmvIfEEN4absl12lts_202301256StatusE19cusparseOperation_tiiiPKT_S8_PKiSA_S8_S8_PS6_+0x20f): undefined reference to `cusparseCsrmvEx_bufferSize'
cuda_sparse.cc:(.text._ZNK10tensorflow9GpuSparse5CsrmvIfEEN4absl12lts_202301256StatusE19cusparseOperation_tiiiPKT_S8_PKiSA_S8_S8_PS6_+0x389): undefined reference to `cusparseCsrmvEx'
bazel-out/k8-opt/bin/tensorflow/core/util/libcuda_sparse.pic.lo(cuda_sparse.pic.o): In function `absl::lts_20230125::Status tensorflow::GpuSparse::Csrmv<double>(cusparseOperation_t, int, int, int, double const*, double const*, int const*, int const*, double const*, double const*, double*) const':
cuda_sparse.cc:(.text._ZNK10tensorflow9GpuSparse5CsrmvIdEEN4absl12lts_202301256StatusE19cusparseOperation_tiiiPKT_S8_PKiSA_S8_S8_PS6_+0x215): undefined reference to `cusparseCsrmvEx_bufferSize'
cuda_sparse.cc:(.text._ZNK10tensorflow9GpuSparse5CsrmvIdEEN4absl12lts_202301256StatusE19cusparseOperation_tiiiPKT_S8_PKiSA_S8_S8_PS6_+0x38f): undefined reference to `cusparseCsrmvEx'
bazel-out/k8-opt/bin/tensorflow/core/util/libcuda_sparse.pic.lo(cuda_sparse.pic.o): In function `absl::lts_20230125::Status tensorflow::GpuSparse::Csrmv<std::complex<float> >(cusparseOperation_t, int, int, int, std::complex<float> const*, std::complex<float> const*, int const*, int const*, std::complex<float> const*, std::complex<float> const*, std::complex<float>*) const':
cuda_sparse.cc:(.text._ZNK10tensorflow9GpuSparse5CsrmvISt7complexIfEEEN4absl12lts_202301256StatusE19cusparseOperation_tiiiPKT_SA_PKiSC_SA_SA_PS8_+0x215): undefined reference to `cusparseCsrmvEx_bufferSize'
cuda_sparse.cc:(.text._ZNK10tensorflow9GpuSparse5CsrmvISt7complexIfEEEN4absl12lts_202301256StatusE19cusparseOperation_tiiiPKT_SA_PKiSC_SA_SA_PS8_+0x38f): undefined reference to `cusparseCsrmvEx'
bazel-out/k8-opt/bin/tensorflow/core/util/libcuda_sparse.pic.lo(cuda_sparse.pic.o): In function `absl::lts_20230125::Status tensorflow::GpuSparse::Csrmv<std::complex<double> >(cusparseOperation_t, int, int, int, std::complex<double> const*, std::complex<double> const*, int const*, int const*, std::complex<double> const*, std::complex<double> const*, std::complex<double>*) const':
cuda_sparse.cc:(.text._ZNK10tensorflow9GpuSparse5CsrmvISt7complexIdEEEN4absl12lts_202301256StatusE19cusparseOperation_tiiiPKT_SA_PKiSC_SA_SA_PS8_+0x215): undefined reference to `cusparseCsrmvEx_bufferSize'
cuda_sparse.cc:(.text._ZNK10tensorflow9GpuSparse5CsrmvISt7complexIdEEEN4absl12lts_202301256StatusE19cusparseOperation_tiiiPKT_SA_PKiSC_SA_SA_PS8_+0x38f): undefined reference to `cusparseCsrmvEx'
bazel-out/k8-opt/bin/tensorflow/core/util/libcuda_sparse.pic.lo(cuda_sparse.pic.o): In function `absl::lts_20230125::Status tensorflow::GpuSparse::CsrgemmBufferSize<float>(int, int, int, cusparseMatDescr*, int, int const*, int const*, cusparseMatDescr*, int, int const*, int const*, csrgemm2Info*, unsigned long*)':
cuda_sparse.cc:(.text._ZN10tensorflow9GpuSparse17CsrgemmBufferSizeIfEEN4absl12lts_202301256StatusEiiiP16cusparseMatDescriPKiS8_S6_iS8_S8_P12csrgemm2InfoPm+0x89): undefined reference to `cusparseScsrgemm2_bufferSizeExt'
bazel-out/k8-opt/bin/tensorflow/core/util/libcuda_sparse.pic.lo(cuda_sparse.pic.o): In function `absl::lts_20230125::Status tensorflow::GpuSparse::CsrgemmBufferSize<double>(int, int, int, cusparseMatDescr*, int, int const*, int const*, cusparseMatDescr*, int, int const*, int const*, csrgemm2Info*, unsigned long*)':
cuda_sparse.cc:(.text._ZN10tensorflow9GpuSparse17CsrgemmBufferSizeIdEEN4absl12lts_202301256StatusEiiiP16cusparseMatDescriPKiS8_S6_iS8_S8_P12csrgemm2InfoPm+0x89): undefined reference to `cusparseDcsrgemm2_bufferSizeExt'
bazel-out/k8-opt/bin/tensorflow/core/util/libcuda_sparse.pic.lo(cuda_sparse.pic.o): In function `absl::lts_20230125::Status tensorflow::GpuSparse::CsrgemmBufferSize<std::complex<float> >(int, int, int, cusparseMatDescr*, int, int const*, int const*, cusparseMatDescr*, int, int const*, int const*, csrgemm2Info*, unsigned long*)':
cuda_sparse.cc:(.text._ZN10tensorflow9GpuSparse17CsrgemmBufferSizeISt7complexIfEEEN4absl12lts_202301256StatusEiiiP16cusparseMatDescriPKiSA_S8_iSA_SA_P12csrgemm2InfoPm+0x89): undefined reference to `cusparseCcsrgemm2_bufferSizeExt'
bazel-out/k8-opt/bin/tensorflow/core/util/libcuda_sparse.pic.lo(cuda_sparse.pic.o): In function `absl::lts_20230125::Status tensorflow::GpuSparse::CsrgemmBufferSize<std::complex<double> >(int, int, int, cusparseMatDescr*, int, int const*, int const*, cusparseMatDescr*, int, int const*, int const*, csrgemm2Info*, unsigned long*)':
cuda_sparse.cc:(.text._ZN10tensorflow9GpuSparse17CsrgemmBufferSizeISt7complexIdEEEN4absl12lts_202301256StatusEiiiP16cusparseMatDescriPKiSA_S8_iSA_SA_P12csrgemm2InfoPm+0x89): undefined reference to `cusparseZcsrgemm2_bufferSizeExt'
bazel-out/k8-opt/bin/tensorflow/core/util/libcuda_sparse.pic.lo(cuda_sparse.pic.o): In function `tensorflow::GpuSparse::CsrgemmNnz(int, int, int, cusparseMatDescr*, int, int const*, int const*, cusparseMatDescr*, int, int const*, int const*, cusparseMatDescr*, int*, int*, csrgemm2Info*, void*)':
cuda_sparse.cc:(.text._ZN10tensorflow9GpuSparse10CsrgemmNnzEiiiP16cusparseMatDescriPKiS4_S2_iS4_S4_S2_PiS5_P12csrgemm2InfoPv+0x8a): undefined reference to `cusparseXcsrgemm2Nnz'
bazel-out/k8-opt/bin/tensorflow/core/util/libcuda_sparse.pic.lo(cuda_sparse.pic.o): In function `absl::lts_20230125::Status tensorflow::GpuSparse::Csrgemm<float>(int, int, int, cusparseMatDescr*, int, float const*, int const*, int const*, cusparseMatDescr*, int, float const*, int const*, int const*, cusparseMatDescr*, float*, int*, int*, csrgemm2Info*, void*)':
cuda_sparse.cc:(.text._ZN10tensorflow9GpuSparse7CsrgemmIfEEN4absl12lts_202301256StatusEiiiP16cusparseMatDescriPKT_PKiSB_S6_iS9_SB_SB_S6_PS7_PiSD_P12csrgemm2InfoPv+0xb3): undefined reference to `cusparseScsrgemm2'
bazel-out/k8-opt/bin/tensorflow/core/util/libcuda_sparse.pic.lo(cuda_sparse.pic.o): In function `absl::lts_20230125::Status tensorflow::GpuSparse::Csrgemm<double>(int, int, int, cusparseMatDescr*, int, double const*, int const*, int const*, cusparseMatDescr*, int, double const*, int const*, int const*, cusparseMatDescr*, double*, int*, int*, csrgemm2Info*, void*)':
cuda_sparse.cc:(.text._ZN10tensorflow9GpuSparse7CsrgemmIdEEN4absl12lts_202301256StatusEiiiP16cusparseMatDescriPKT_PKiSB_S6_iS9_SB_SB_S6_PS7_PiSD_P12csrgemm2InfoPv+0xb3): undefined reference to `cusparseDcsrgemm2'
bazel-out/k8-opt/bin/tensorflow/core/util/libcuda_sparse.pic.lo(cuda_sparse.pic.o): In function `absl::lts_20230125::Status tensorflow::GpuSparse::Csrgemm<std::complex<float> >(int, int, int, cusparseMatDescr*, int, std::complex<float> const*, int const*, int const*, cusparseMatDescr*, int, std::complex<float> const*, int const*, int const*, cusparseMatDescr*, std::complex<float>*, int*, int*, csrgemm2Info*, void*)':
cuda_sparse.cc:(.text._ZN10tensorflow9GpuSparse7CsrgemmISt7complexIfEEEN4absl12lts_202301256StatusEiiiP16cusparseMatDescriPKT_PKiSD_S8_iSB_SD_SD_S8_PS9_PiSF_P12csrgemm2InfoPv+0xb3): undefined reference to `cusparseCcsrgemm2'
bazel-out/k8-opt/bin/tensorflow/core/util/libcuda_sparse.pic.lo(cuda_sparse.pic.o): In function `absl::lts_20230125::Status tensorflow::GpuSparse::Csrgemm<std::complex<double> >(int, int, int, cusparseMatDescr*, int, std::complex<double> const*, int const*, int const*, cusparseMatDescr*, int, std::complex<double> const*, int const*, int const*, cusparseMatDescr*, std::complex<double>*, int*, int*, csrgemm2Info*, void*)':
cuda_sparse.cc:(.text._ZN10tensorflow9GpuSparse7CsrgemmISt7complexIdEEEN4absl12lts_202301256StatusEiiiP16cusparseMatDescriPKT_PKiSD_S8_iSB_SD_SD_S8_PS9_PiSF_P12csrgemm2InfoPv+0xb3): undefined reference to `cusparseZcsrgemm2'
clang-16: error: linker command failed with exit code 1 (use -v to see invocation)
Target //tensorflow/tools/pip_package:build_pip_package failed to build
Use --verbose_failures to see the command lines of failed build steps.
INFO: Elapsed time: 1154.437s, Critical Path: 625.33s
INFO: 32644 processes: 6751 internal, 25893 local.
FAILED: Build did NOT complete successfully

```
```


### Relevant log output

_No response_