Spaces:

MrYXJ
/

calculate-model-flops

Running

大模型部署推理速度怎么计算

by wangchenkang2023 - opened Jan 10, 2024

Jan 10, 2024

请问模型推理的速度怎么计算，每秒钟多少个tokens。情景：某个大模型(如：baichuan2-7b)部署后，怎样计算它的每秒钟多少个tokens推理速度

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment