gstaff's picture
Create README.md
185d660 verified

TensorRT-LLM Engine Files for Mistral-7B-instruct-v0.2

This repo contains TensorRT-LLM engine files for Mistral-7B-instruct-v0.2 compiled on Windows 11 in single-GPU mode on a RTX 3080Ti GPU.