Update reproducibility text

src/about.py

@@ -113,32 +113,34 @@ These benchmarks go beyond basic reasoning and evaluate more advanced, autonomou
 """
 
 REPRODUCIBILITY_TEXT = """
-## Reproduce and Extend the Leaderboard
-
-### 1) Make sure you can load your model and tokenizer using AutoClasses:
-```python
-from transformers import AutoConfig, AutoModel, AutoTokenizer
-config = AutoConfig.from_pretrained("your model name", revision=revision)
-model = AutoModel.from_pretrained("your model name", revision=revision)
-tokenizer = AutoTokenizer.from_pretrained("your model name", revision=revision)
-```
-If this step fails, follow the error messages to debug your model before submitting it. It's likely your model has been improperly uploaded.
+## 🛠️ Reproducibility
+The [Vector State of Evaluation Leaderboard Repository](https://github.com/VectorInstitute/evaluation) repository contains the evaluation script to reproduce results presented on the leaderboard.
+
+### Install dependencies
 
-Note: make sure your model is public!
-Note: if your model needs `use_remote_code=True`, we do not support this option yet but we are working on adding it, stay posted!
+1. Create a python virtual env. with ```python>=3.10``` and activate it
+```bash
+python -m venv env
+source env/bin/activate
+```
 
-### 2) Convert your model weights to [safetensors](https://huggingface.co/docs/safetensors/index)
-It's a new format for storing weights which is safer and faster to load and use. It will also allow us to add the number of parameters of your model to the `Extended Viewer`!
+2. Install ```inspect_ai```, ```inspect_evals``` and other dependencies based on ```requirements.txt```
+```bash
+python -m pip install -r requirements.txt
+```
 
-### 3) Make sure your model has an open license!
-This is a leaderboard for Open LLMs, and we'd love for as many people as possible to know they can use your model 🤗
+3. Install any packages required for models you'd like to evaluate and use as grader models
 
-### 4) Fill up your model card
-When we add extra information about models to the leaderboard, it will be automatically taken from the model card
+    Note: ```openai``` package is already included in ```requirements.txt```
+```bash
+python -m pip install <model_package>
+```
 
-## In case of model failure
-If your model is displayed in the `FAILED` category, its execution stopped.
-Make sure you have followed the above steps first.
-If everything is done, check you can launch the EleutherAIHarness on your model locally, using the above command without modifications (you can add `--limit` to limit the number of examples per task).
+### Run Inspect evaluation
+1. Update the ```src/evals_cfg/run_cfg.yaml``` file to select the evals (base/agentic) and include all models to be evaluated
+2. Now run evaluation as follows:
+```bash
+python src/run_evals.py
+```
 """