Ahmadzei's picture
added 3 more tables for large emb model
5fa1a76
raw
history blame contribute delete
163 Bytes
Next, the timeout is reset on every queue fetch, meaning you could
wait much more than 1ms before running the inference (delaying the first request
by that much).