Fedir Zadniprovskyi commited on
Commit
669a858
·
1 Parent(s): 526f427

chore: misc changes

Browse files
Files changed (3) hide show
  1. Dockerfile +1 -0
  2. compose.yaml +0 -4
  3. docs/installation.md +25 -4
Dockerfile CHANGED
@@ -19,6 +19,7 @@ WORKDIR $HOME/faster-whisper-server
19
  COPY --chown=ubuntu --from=ghcr.io/astral-sh/uv:0.5.14 /uv /bin/uv
20
  # https://docs.astral.sh/uv/guides/integration/docker/#intermediate-layers
21
  # https://docs.astral.sh/uv/guides/integration/docker/#compiling-bytecode
 
22
  RUN --mount=type=cache,target=/root/.cache/uv \
23
  --mount=type=bind,source=uv.lock,target=uv.lock \
24
  --mount=type=bind,source=pyproject.toml,target=pyproject.toml \
 
19
  COPY --chown=ubuntu --from=ghcr.io/astral-sh/uv:0.5.14 /uv /bin/uv
20
  # https://docs.astral.sh/uv/guides/integration/docker/#intermediate-layers
21
  # https://docs.astral.sh/uv/guides/integration/docker/#compiling-bytecode
22
+ # TODO: figure out if `/home/ubuntu/.cache/uv` should be used instead of `/root/.cache/uv`
23
  RUN --mount=type=cache,target=/root/.cache/uv \
24
  --mount=type=bind,source=uv.lock,target=uv.lock \
25
  --mount=type=bind,source=pyproject.toml,target=pyproject.toml \
compose.yaml CHANGED
@@ -11,7 +11,3 @@ services:
11
  restart: unless-stopped
12
  ports:
13
  - 8000:8000
14
- develop:
15
- watch:
16
- - path: faster_whisper_server
17
- action: rebuild
 
11
  restart: unless-stopped
12
  ports:
13
  - 8000:8000
 
 
 
 
docs/installation.md CHANGED
@@ -70,26 +70,47 @@ TODO: just reference the existing compose file in the repo
70
  === "CUDA"
71
 
72
  ```bash
73
- docker run --rm --detach --publish 8000:8000 --name faster-whisper-server --volume hf-hub-cache:/home/ubuntu/.cache/huggingface/hub --gpus=all fedirz/faster-whisper-server:latest-cuda
 
 
 
 
 
 
 
74
  ```
75
 
76
  === "CUDA (with CDI feature enabled)"
77
 
78
  ```bash
79
- docker run --rm --detach --publish 8000:8000 --name faster-whisper-server --volume hf-hub-cache:/home/ubuntu/.cache/huggingface/hub --device=nvidia.com/gpu=all fedirz/faster-whisper-server:latest-cuda
 
 
 
 
 
 
 
80
  ```
81
 
82
  === "CPU"
83
 
84
  ```bash
85
- docker run --rm --detach --publish 8000:8000 --name faster-whisper-server --volume hf-hub-cache:/home/ubuntu/.cache/huggingface/hub fedirz/faster-whisper-server:latest-cpu
 
 
 
 
 
 
86
  ```
87
 
88
  ## Kubernetes
 
89
  WARNING: it was written few months ago and may be outdated.
90
  Please refer to this [blog post](https://substratus.ai/blog/deploying-faster-whisper-on-k8s)
91
 
92
- ## Python (requires Python 3.12+)
93
 
94
  ```bash
95
  git clone https://github.com/fedirz/faster-whisper-server.git
 
70
  === "CUDA"
71
 
72
  ```bash
73
+ docker run \
74
+ --rm \
75
+ --detach \
76
+ --publish 8000:8000 \
77
+ --name faster-whisper-server \
78
+ --volume hf-hub-cache:/home/ubuntu/.cache/huggingface/hub \
79
+ --gpus=all \
80
+ fedirz/faster-whisper-server:latest-cuda
81
  ```
82
 
83
  === "CUDA (with CDI feature enabled)"
84
 
85
  ```bash
86
+ docker run \
87
+ --rm \
88
+ --detach \
89
+ --publish 8000:8000 \
90
+ --name faster-whisper-server \
91
+ --volume hf-hub-cache:/home/ubuntu/.cache/huggingface/hub \
92
+ --device=nvidia.com/gpu=all \
93
+ fedirz/faster-whisper-server:latest-cuda
94
  ```
95
 
96
  === "CPU"
97
 
98
  ```bash
99
+ docker run \
100
+ --rm \
101
+ --detach \
102
+ --publish 8000:8000 \
103
+ --name faster-whisper-server \
104
+ --volume hf-hub-cache:/home/ubuntu/.cache/huggingface/hub \
105
+ fedirz/faster-whisper-server:latest-cpu
106
  ```
107
 
108
  ## Kubernetes
109
+
110
  WARNING: it was written few months ago and may be outdated.
111
  Please refer to this [blog post](https://substratus.ai/blog/deploying-faster-whisper-on-k8s)
112
 
113
+ ## Python (requires Python 3.12+ and `uv` package manager)
114
 
115
  ```bash
116
  git clone https://github.com/fedirz/faster-whisper-server.git