Show HN: Incremental JSON parser for streaming LLM tool calls in Ruby https://ift.tt/aPAc1Bj
Show HN: Incremental JSON parser for streaming LLM tool calls in Ruby Built this for streaming AI tool calls. LLMs stream function arguments as JSON character-by-character. Most parsers reparse from scratch each time - O(n²) behavior that causes UI lag. This maintains parsing state, processing only new characters. True O(n) performance that stays imperceptible throughout the entire response. Ruby gem, MIT licensed. Would love feedback. https://ift.tt/McLDBUu October 23, 2025 at 01:02AM
Comments
Post a Comment