Sunday, August 3, 2025

Show HN: WebGPU enables local LLM in the browser – demo site with AI chat https://ift.tt/q1RoMfu

Show HN: WebGPU enables local LLM in the browser – demo site with AI chat Browser LLM demo working on JavaScript and WebGPU. WebGPU is already supported in Chrome, Safari, Firefox, iOS (v26) and Android. Demo, similar to ChatGPT https://andreinwald.github.io/browser-llm/ Code https://ift.tt/ow06cYE - No need to use your OPENAI_API_KEY - its local model that runs on your device - No network requests to any API - No need to install any program - No need to download files on your device (model is cached in browser) - Site will ask before downloading large files (llm model) to browser cache - Hosted on Github Pages from this repo - secure, because you see what you are running https://andreinwald.github.io/browser-llm/ August 2, 2025 at 07:39PM

No comments:

Post a Comment

Show HN: FFlags – Feature flags as code, served from the edge https://ift.tt/A5MnhEs

Show HN: FFlags – Feature flags as code, served from the edge Hi HN, I'm the creator of FFlags. I built this because I wanted a feature ...