Why on-device matters
All inference here runs in your tab — WebGPU and WebNN where your browser supports them, WebAssembly where it does not. No image ever leaves your device, there is no per-request API cost, and latency is whatever your hardware can do. The same techniques apply to kiosks, set-top boxes and mobile apps where privacy, cost or connectivity rule out the cloud.