Commit Graph

7 Commits

Author SHA1 Message Date
c5e6414daf Fix last empty content delta in Case 5 (post-section-close)
Return None instead of DeltaMessage(content='') when delta_text
exists but there's no new content after the section end marker.
2026-04-14 07:08:45 +00:00
a404735b2d Fix empty content deltas and leaked section markers in streaming
Tool parser:
- Case 3/4: return None instead of DeltaMessage(content='') when
  inside an open tool section with no parseable content yet.
  Empty-string content deltas pollute the response and break the
  content=null vs content='' contract with non-streaming.

Reasoning parser:
- Suppress tool-calls section markers from content forwarding.
  The tool parser detects them via current_text re-parsing; forwarding
  them as content causes double-handling.
- Already-past-reasoning path: strip section markers from content
  for the same reason.
2026-04-14 06:46:19 +00:00
fcf8fd134e we need to forward the context using the old way 2026-04-14 06:18:32 +00:00
d0c9c5c482 we actually need the empty deltas to keep the stream going 2026-04-14 05:48:04 +00:00
d4568f1d80 more speculative decoding fixes 2026-04-14 05:06:30 +00:00
d4813de98f fix empty content deltas 2026-04-14 03:49:39 +00:00
9be82d3574 add the tool call parser fixes for eagle decode 2026-04-14 03:13:24 +00:00