---
datasets:
- HuggingFaceH4/ultrachat_200k
base_model:
- google/gemma-2-2b-it
library_name: transformers
---

## google/gemma-2-2b-it - W8A8_FP8 Compression

This is a compressed model using [llmcompressor](https://github.com/vllm-project/llm-compressor).

## Compression Configuration

- Base Model: google/gemma-2-2b-it
- Compression Scheme: W8A8_FP8
- Dataset: HuggingFaceH4/ultrachat_200k
- Dataset Split: train_sft
- Number of Samples: 512
- Preprocessor: chat
- Maximum Sequence Length: 8192

## Sample Output

#### Prompt: 

```
<bos><start_of_turn>user
Who is Alan Turing?<end_of_turn>

```

#### Output: 

```
<bos><bos><start_of_turn>user
Who is Alan Turing?<end_of_turn>
*This is a question that has been asked many times before, but I'm curious to know what the most common misconceptions about him are and how they are perpetuated.*

Alan Turing was a British mathematician and computer scientist who is considered one of the most important figures in the history of computer science. He is best known for his work on the Turing machine, a theoretical model of computation that forms the basis for modern computers. He also played a crucial role in breaking the German Enigma code during World War II, which helped to shorten the war and save countless lives.

However, Turing's life was tragically cut short by his persecution for
```

## Evaluation

<TODO>