The model runs locally in a Web Worker using the WebAssembly CLI and browser WebGPU.
Select a GGUF and any required sidecar files. Available models depend on the build configuration.
Ready. A WebGPU-capable browser and localhost or HTTPS are required.