Hugging Face's logo

gstaff
/
TensorRT-LLM-engine-Mistral-7B-instruct-v0.2

Transformers
Inference Endpoints
Model card Files Community
YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

TensorRT-LLM Engine Files for Mistral-7B-instruct-v0.2

This repo contains TensorRT-LLM engine files for Mistral-7B-instruct-v0.2 compiled on Windows 11 in single-GPU mode on a RTX 3080Ti GPU.

Downloads last month
13
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no pipeline_tag.