Hugging Face's logo

gstaff
/
TensorRT-LLM-engine-Mistral-7B-instruct-v0.2

Transformers
Model card Files Community
TensorRT-LLM-engine-Mistral-7B-instruct-v0.2 / llama_float16_tp1_rank0.engine

Commit History

Add TensorRT-LLM engine files for Mistral-7B-instruct-v0.2 compiled on Windows 11 NVIDIA GeForce RTX 3080Ti for single GPU mode.
bf19ed4
verified

gstaff commited on