gstaff
/

TensorRT-LLM-engine-Mistral-7B-instruct-v0.2

Model card Files Files and versions Community

TensorRT-LLM-engine-Mistral-7B-instruct-v0.2

Ctrl+K

Ctrl+K

1 contributor

History: 3 commits

gstaff's picture

Create README.md

185d660 verified over 1 year ago

.gitattributes

1.59 kB

Add TensorRT-LLM engine files for Mistral-7B-instruct-v0.2 compiled on Windows 11 NVIDIA GeForce RTX 3080Ti for single GPU mode. over 1 year ago
README.md

193 Bytes

Create README.md over 1 year ago
config.json

1.54 kB

Add TensorRT-LLM engine files for Mistral-7B-instruct-v0.2 compiled on Windows 11 NVIDIA GeForce RTX 3080Ti for single GPU mode. over 1 year ago
llama_float16_tp1_rank0.engine

4.2 GB
LFS

Add TensorRT-LLM engine files for Mistral-7B-instruct-v0.2 compiled on Windows 11 NVIDIA GeForce RTX 3080Ti for single GPU mode. over 1 year ago
model.cache

227 kB

Add TensorRT-LLM engine files for Mistral-7B-instruct-v0.2 compiled on Windows 11 NVIDIA GeForce RTX 3080Ti for single GPU mode. over 1 year ago