Fix Ollama streaming response parser to handle newline-delimited JSON

[Copilot]

Summary

• What: Fix streaming response parsing in orchestrate_content.py to correctly parse Ollama's newline-delimited JSON format.
• Why: Previous implementation concatenated raw JSON bytes instead of extracting response text from JSON objects, resulting in malformed content.

Changes

• Parse streaming chunks as newline-delimited JSON objects, extracting the "response" field from each line
• Buffer incomplete lines across chunk boundaries for proper JSON parsing
• Extract helper function process_json_line to eliminate code duplication

Before:

chunks = []
async for chunk in resp.content.iter_chunked(1024):
    chunks.append(chunk)
text = b"".join(chunks).decode("utf-8", errors="ignore")

After:

buffer = ""
response_parts = []
async for chunk in resp.content.iter_chunked(1024):
    buffer += chunk.decode("utf-8", errors="ignore")
    while "\n" in buffer:
        line, buffer = buffer.split("\n", 1)
        json_obj = json.loads(line.strip())
        response_parts.append(json_obj["response"])
text = "".join(response_parts)

Testing

• All existing unit tests pass (test_orchestrate_content.py)
• Streaming mode test validates TTFT capture and response text extraction

Checklist

• Streaming parser correctly handles newline-delimited JSON
• Response text properly extracted from "response" field
• Code duplication eliminated
• All tests pass

---

💡 You can make Copilot smarter by setting up custom instructions, customizing its development environment and configuring Model Context Protocol (MCP) servers. Learn more Copilot coding agent tips in the docs.

[73junito]

viewed

[Copilot]

Pull request overview

This PR fixes the Ollama streaming response parser to correctly handle newline-delimited JSON format. The previous implementation incorrectly concatenated raw JSON bytes, while the updated code properly parses each JSON line and extracts the response text field.

Changes:

• Parse streaming chunks as newline-delimited JSON objects, extracting the "response" field from each line
• Buffer incomplete lines across chunk boundaries for proper JSON parsing
• Extract helper function process_json_line to handle JSON line processing with error handling

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.