Show HN: I built a free in-browser Llama 3 chatbot powered by WebGPU https://ift.tt/MesRq58

Show HN: I built a free in-browser Llama 3 chatbot powered by WebGPU I spent the last few days building out a nicer ChatGPT-like interface to use Mistral 7B and Llama 3 fully within a browser (no deps and installs). I’ve used the WebLLM project by MLC AI for a while to interact with LLMs in the browser when handling sensitive data but I found their UI quite lacking for serious use so I built a much better interface around WebLLM. I’ve been using it as a therapist and coach. And it’s wonderful knowing that my personal information never leaves my local computer. Should work on Desktop with Chrome or Edge. Other browsers are adding WebGPU support as well - see the Github for details on how you can get it to work on other browsers. Note: after you send the first message, the model will be downloaded to your browser cache. That can take a while depending on the model and your internet connection. But on subsequent page loads, the model should be loaded from the IndexedDB cache so it should be much faster. The project is open source (Apache 2.0) on Github. If you like it, I’d love contributions, particularly around making the first load faster. Github: https://ift.tt/HxQSYhu Demo: https://secretllama.com https://ift.tt/HxQSYhu May 4, 2024 at 02:56AM

Show HN: Lightsaber Battle – May the Fourth Be with You https://ift.tt/PEmVMyw

Show HN: Lightsaber Battle – May the Fourth Be with You Hey folks, join me in a lightsaber battle! I love Star Wars and may 4th is a special day for me, so I made this little thing. You can change the saver color and background. Let me know what you guys think and May the Fourth be With You https://ift.tt/KH9EbWa May 4, 2024 at 02:01AM

Show HN: BandMatch – "Tinder" but for finding musicians to create bands/collab https://ift.tt/R7I59Ja

Show HN: BandMatch – "Tinder" but for finding musicians to create bands/collab https://bandmatch.app May 3, 2024 at 11:41PM

Show HN: Prompt-Tower – Simplify writing prompts with multiple code blocks https://ift.tt/XAFWcpe

Show HN: Prompt-Tower – Simplify writing prompts with multiple code blocks Prompt-tower simplifies and speeds-up how prompts with multiple code blocks are written. It's often a pain jumping between files, classes, functions, etc and copying/pasting everything, wrapping and annotating the blocks, and finally sending the prompt off for generation. After seeing filekitty [1], I felt inspired to build my version of the idea... which is a vscode extension that fits better in a developer's context. check it out: https://ift.tt/Lv8lX1T... demo gif: https://ift.tt/Iho7Pnx repo: https://ift.tt/H7oRA9O [1] https://ift.tt/tLGeBMv May 3, 2024 at 11:40PM

Show HN: 2,629 Tiny Demos from Pouet, Running in the Browser https://ift.tt/6azVylj

Show HN: 2,629 Tiny Demos from Pouet, Running in the Browser https://ift.tt/JhmGK5M May 3, 2024 at 02:27AM

Show HN:Create and Share beautiful screenshots for free https://ift.tt/SazAfVP

Show HN:Create and Share beautiful screenshots for free https://ift.tt/wXUZCRL May 3, 2024 at 01:06AM

Show HN: AI-Powered Summaries for LinkedIn Posts https://ift.tt/mrDghkx

Show HN: AI-Powered Summaries for LinkedIn Posts https://www.linkedin-tldr.xyz/ May 3, 2024 at 12:45AM