Update vllm_deployment_guide.md
Browse files- vllm_deployment_guide.md +3 -0
vllm_deployment_guide.md
CHANGED
|
@@ -48,6 +48,9 @@ To ensure consistency and stability of the deployment environment, we recommend
|
|
| 48 |
- If you are using a Docker image with vLLM version lower than the required version, you will need to:
|
| 49 |
1. Update to the latest vLLM code
|
| 50 |
2. Recompile vLLM from source. Follow the compilation instructions in Solution 2 of the Common Issues section
|
|
|
|
|
|
|
|
|
|
| 51 |
|
| 52 |
1. Get the container image:
|
| 53 |
```bash
|
|
|
|
| 48 |
- If you are using a Docker image with vLLM version lower than the required version, you will need to:
|
| 49 |
1. Update to the latest vLLM code
|
| 50 |
2. Recompile vLLM from source. Follow the compilation instructions in Solution 2 of the Common Issues section
|
| 51 |
+
- Special Note: For vLLM versions between 0.8.3 and 0.9.2, you need to modify the model configuration:
|
| 52 |
+
1. Open `config.json`
|
| 53 |
+
2. Change `config['architectures'] = ["MiniMaxM1ForCausalLM"]` to `config['architectures'] = ["MiniMaxText01ForCausalLM"]`
|
| 54 |
|
| 55 |
1. Get the container image:
|
| 56 |
```bash
|