Sunday, August 3, 2025

Show HN: WebGPU enables local LLM in the browser – demo site with AI chat https://ift.tt/q1RoMfu

Show HN: WebGPU enables local LLM in the browser – demo site with AI chat Browser LLM demo working on JavaScript and WebGPU. WebGPU is already supported in Chrome, Safari, Firefox, iOS (v26) and Android. Demo, similar to ChatGPT https://andreinwald.github.io/browser-llm/ Code https://ift.tt/ow06cYE - No need to use your OPENAI_API_KEY - its local model that runs on your device - No network requests to any API - No need to install any program - No need to download files on your device (model is cached in browser) - Site will ask before downloading large files (llm model) to browser cache - Hosted on Github Pages from this repo - secure, because you see what you are running https://andreinwald.github.io/browser-llm/ August 2, 2025 at 07:39PM

No comments:

Post a Comment

Show HN: The Cascade Graph – An interactive map of AI and energy constraints https://ift.tt/O47EcUS

Show HN: The Cascade Graph – An interactive map of AI and energy constraints Hello, I wanted to share with you all a interactive map of the ...