Spaces:
Configuration error
Configuration error
Fedir Zadniprovskyi
commited on
Commit
·
669a858
1
Parent(s):
526f427
chore: misc changes
Browse files- Dockerfile +1 -0
- compose.yaml +0 -4
- docs/installation.md +25 -4
Dockerfile
CHANGED
@@ -19,6 +19,7 @@ WORKDIR $HOME/faster-whisper-server
|
|
19 |
COPY --chown=ubuntu --from=ghcr.io/astral-sh/uv:0.5.14 /uv /bin/uv
|
20 |
# https://docs.astral.sh/uv/guides/integration/docker/#intermediate-layers
|
21 |
# https://docs.astral.sh/uv/guides/integration/docker/#compiling-bytecode
|
|
|
22 |
RUN --mount=type=cache,target=/root/.cache/uv \
|
23 |
--mount=type=bind,source=uv.lock,target=uv.lock \
|
24 |
--mount=type=bind,source=pyproject.toml,target=pyproject.toml \
|
|
|
19 |
COPY --chown=ubuntu --from=ghcr.io/astral-sh/uv:0.5.14 /uv /bin/uv
|
20 |
# https://docs.astral.sh/uv/guides/integration/docker/#intermediate-layers
|
21 |
# https://docs.astral.sh/uv/guides/integration/docker/#compiling-bytecode
|
22 |
+
# TODO: figure out if `/home/ubuntu/.cache/uv` should be used instead of `/root/.cache/uv`
|
23 |
RUN --mount=type=cache,target=/root/.cache/uv \
|
24 |
--mount=type=bind,source=uv.lock,target=uv.lock \
|
25 |
--mount=type=bind,source=pyproject.toml,target=pyproject.toml \
|
compose.yaml
CHANGED
@@ -11,7 +11,3 @@ services:
|
|
11 |
restart: unless-stopped
|
12 |
ports:
|
13 |
- 8000:8000
|
14 |
-
develop:
|
15 |
-
watch:
|
16 |
-
- path: faster_whisper_server
|
17 |
-
action: rebuild
|
|
|
11 |
restart: unless-stopped
|
12 |
ports:
|
13 |
- 8000:8000
|
|
|
|
|
|
|
|
docs/installation.md
CHANGED
@@ -70,26 +70,47 @@ TODO: just reference the existing compose file in the repo
|
|
70 |
=== "CUDA"
|
71 |
|
72 |
```bash
|
73 |
-
docker run
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
74 |
```
|
75 |
|
76 |
=== "CUDA (with CDI feature enabled)"
|
77 |
|
78 |
```bash
|
79 |
-
docker run
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
80 |
```
|
81 |
|
82 |
=== "CPU"
|
83 |
|
84 |
```bash
|
85 |
-
docker run
|
|
|
|
|
|
|
|
|
|
|
|
|
86 |
```
|
87 |
|
88 |
## Kubernetes
|
|
|
89 |
WARNING: it was written few months ago and may be outdated.
|
90 |
Please refer to this [blog post](https://substratus.ai/blog/deploying-faster-whisper-on-k8s)
|
91 |
|
92 |
-
## Python (requires Python 3.12+)
|
93 |
|
94 |
```bash
|
95 |
git clone https://github.com/fedirz/faster-whisper-server.git
|
|
|
70 |
=== "CUDA"
|
71 |
|
72 |
```bash
|
73 |
+
docker run \
|
74 |
+
--rm \
|
75 |
+
--detach \
|
76 |
+
--publish 8000:8000 \
|
77 |
+
--name faster-whisper-server \
|
78 |
+
--volume hf-hub-cache:/home/ubuntu/.cache/huggingface/hub \
|
79 |
+
--gpus=all \
|
80 |
+
fedirz/faster-whisper-server:latest-cuda
|
81 |
```
|
82 |
|
83 |
=== "CUDA (with CDI feature enabled)"
|
84 |
|
85 |
```bash
|
86 |
+
docker run \
|
87 |
+
--rm \
|
88 |
+
--detach \
|
89 |
+
--publish 8000:8000 \
|
90 |
+
--name faster-whisper-server \
|
91 |
+
--volume hf-hub-cache:/home/ubuntu/.cache/huggingface/hub \
|
92 |
+
--device=nvidia.com/gpu=all \
|
93 |
+
fedirz/faster-whisper-server:latest-cuda
|
94 |
```
|
95 |
|
96 |
=== "CPU"
|
97 |
|
98 |
```bash
|
99 |
+
docker run \
|
100 |
+
--rm \
|
101 |
+
--detach \
|
102 |
+
--publish 8000:8000 \
|
103 |
+
--name faster-whisper-server \
|
104 |
+
--volume hf-hub-cache:/home/ubuntu/.cache/huggingface/hub \
|
105 |
+
fedirz/faster-whisper-server:latest-cpu
|
106 |
```
|
107 |
|
108 |
## Kubernetes
|
109 |
+
|
110 |
WARNING: it was written few months ago and may be outdated.
|
111 |
Please refer to this [blog post](https://substratus.ai/blog/deploying-faster-whisper-on-k8s)
|
112 |
|
113 |
+
## Python (requires Python 3.12+ and `uv` package manager)
|
114 |
|
115 |
```bash
|
116 |
git clone https://github.com/fedirz/faster-whisper-server.git
|