Thursday, October 23, 2025

Show HN: Incremental JSON parser for streaming LLM tool calls in Ruby https://ift.tt/SRuDqWH

Show HN: Incremental JSON parser for streaming LLM tool calls in Ruby Built this for streaming AI tool calls. LLMs stream function arguments as JSON character-by-character. Most parsers reparse from scratch each time - O(n²) behavior that causes UI lag. This maintains parsing state, processing only new characters. True O(n) performance that stays imperceptible throughout the entire response. Ruby gem, MIT licensed. Would love feedback. https://ift.tt/Hk4xgqy October 23, 2025 at 01:02AM

No comments:

Post a Comment

Show HN: Git for LLMs – a context management interface https://ift.tt/ph0M2wd

Show HN: Git for LLMs – a context management interface Hi HN, we’re Jamie and Matti, co-founders of Twigg. During our master’s we continuall...