Monday, July 7, 2025

Show HN: Simple wrapper for Chrome's built-in local LLM (Gemini Nano) https://ift.tt/aVL6u8P

Show HN: Simple wrapper for Chrome's built-in local LLM (Gemini Nano) Chrome now includes a native on-device LLM (Gemini Nano) starting in version 138. I've been building with it since it was in origin trials, it's powerful but the official Prompt API is still a bit awkward: - Enforces sessions even for basic usage - Requires user-triggered downloads - Lacks type safety or structured error handling So I open-sourced a small TypeScript wrapper I originally built for other projects to smooth over the rough edges: github: https://ift.tt/i1GBgtZ npm: https://ift.tt/RpvFwUm - Stateless prompt() method inspired by Anthropic's SDK - Built-in error handling and Result-based .Safe.* variants with neverthrow - Token usage checks - Simple initialization that provides a helper to trigger downloads (must be triggered by user action) It’s intentionally minimal for hacking and prototyping. If you need fine-grained control (e.g. streaming, memory control), use the native API directly: https://ift.tt/hLVzSHl Would love to hear what people build with it or any feedback! https://ift.tt/i1GBgtZ July 6, 2025 at 11:24PM

No comments:

Post a Comment

Show HN: Kuqu: SQL for Kubernetes Resources https://ift.tt/M6gmi7C

Show HN: Kuqu: SQL for Kubernetes Resources https://ift.tt/lxBpbOD July 6, 2025 at 09:08PM