DevilKing's blog

冷灯看剑,剑上几分功名?炉香无需计苍生,纵一穿烟逝,万丈云埋,孤阳还照古陵

0%

Bert Production intro

原文链接

we needed to handle over 25,000 inferences per second (and over 1 billion inferences per day), at a latency of under 20ms

benchmark的重要性