Streaming Error

[petrupetru]

when i use my agent with streaming (adk web token streaming or Runner with StreamingMode.SSE) i get this error:
{"error": "Chunk too big"}

This happens for responses that are kind of long (over 500 words)

[adk-bot]

Response from ADK Answering Agent (experimental, answer may be inaccurate)

TLDR: The "Chunk too big" error is likely due to a size limit on the data chunks in the streaming response, probably from an intermediary server. Try checking your server's configuration for any request/response size limits and consider breaking down large responses from your agent into smaller pieces.

---

Hello @petrupetru,

Thank you for your question. The {"error": "Chunk too big"} error you're encountering when using streaming with long responses suggests that a single data chunk in the stream is exceeding a size limit. This limit is often imposed by an intermediary component in your setup, such as a web server, load balancer, or the underlying streaming implementation.

Here are a few steps you can take to troubleshoot and resolve this issue:

1. Check Intermediary Server Configuration: If you are running your ADK application behind a reverse proxy like Nginx or a cloud load balancer, check its configuration for any limits on request body size, response body size, or chunk size. These servers often have default limits that might be smaller than your long responses.

2. Break Down Large Responses: A good practice when dealing with large amounts of data in a streaming context is to break it down into smaller chunks at the application level. Instead of returning a single large block of text (over 500 words as you mentioned), you could modify your agent's logic to yield smaller, more frequent partial responses.

3. Review ADK Streaming Documentation: For more context on how streaming is implemented in ADK and how to best configure it for your needs, you can refer to the official documentation. This might give you further insights into how you can structure your streaming responses to avoid such errors.

   • For an overview of streaming in ADK, see: Streaming in ADK
   • For details on custom streaming implementations, which might give you more control, see: Custom Streaming
   • It might also be helpful to review your runtime configuration settings: RunConfig

By ensuring that no single message in your stream is excessively large, you should be able to avoid the "Chunk too big" error and provide a smoother streaming experience for your users.