Speed -- tok/s
Latency -- ms/tok
KV cache --
Tokens 0
Acceptance (sim) --
Built by Tenzan Logic
Click the badge again, press Esc, or tap outside to close.
TinyServe

WebGPU · ONNX Runtime Web

Watch a language model think, live in your browser.

Built for developers and ML engineers.

Checking if your browser can run the model (WebGPU)…

    Runs in your browser. Nothing leaves your device.