TensorRT-LLM-engine-Mistral-7B-instruct-v0.2 / llama_float16_tp1_rank0.engine
gstaff's picture
Add TensorRT-LLM engine files for Mistral-7B-instruct-v0.2 compiled on Windows 11 NVIDIA GeForce RTX 3080Ti for single GPU mode.
bf19ed4 verified
This file is stored with Git LFS . It is too big to display, but you can still download it.

Git LFS Details

  • SHA256: cdffeb5d22b110c81ca75e6e0089d280315e56dac5c99d9dab0dc898cf080899
  • Pointer size: 135 Bytes
  • Size of remote file: 4.2 GB

Git Large File Storage (LFS) replaces large files with text pointers inside Git, while storing the file contents on a remote server. More info.