Hello I have a tricky case. I have this Workflow
chatTrigger → AI agent 1 → respond to chat node 1(wait for user reply)→ AI agent 2 → respond to chat node 2
How can i stream the response of the agents while keeping the respond to chat node ?
The issue is that Respond to Chat node finalizes the response for that turn of the conversation. This is why it doesn’t support streaming output from upstream nodes but waits until the previous node finishes execution before it sends the message.
When you place the respond to Chat node between agents, the workflow becomes two separate interaction steps, streaming from the agents won’t pass through the Respond to Chat node.
If you really want streaming, the message generating agent needs to be the node that returns the response directly to the chat trigger. In practice this means you should either let the agent stream directly to the chat output or restructure the workflow so that the Respond to Chat node happens only at the final step rather than between agents.
If you need a multi-step interaction, you should treat each step as a separate turn that is triggered by the chat rather than streaming through the intermediate Respond to Chat node.
1 Like
The streaming limitation @AnthonyAtXRay described is accurate — the Respond to Chat node finalizes that turn, so true token-by-token streaming through it isn’t possible right now.
That said, here are the practical approaches depending on what you actually need:
If you need visual streaming in the chat UI:
The only way to get streaming is to have the AI agent be the last node before the Chat Trigger’s response loop. You can’t stream through a Respond to Chat node mid-chain.
What you can do instead: use the Respond to Chat node for intermediate messages (like “Analyzing your request…” or a progress indicator), then let the final AI agent handle the streaming response directly. The intermediate Respond to Chat gives the user feedback without blocking the stream.
If the “streaming feel” matters more than true streaming:
Use the first Respond to Chat to send an acknowledgment immediately ("Let me check with the second agent..."), then when Agent 2 finishes, the chat UI picks up the final streamed response naturally.
Architecture that works:
chatTrigger
→ Agent 1
→ Respond to Chat 1 (sends intermediate message: "Got it, processing...")
→ Agent 2 (with streaming enabled in node settings)
→ [let the chat trigger handle the final response automatically]
The key insight: don’t put Respond to Chat 2 after Agent 2. Let the chat trigger close the loop. The streaming from Agent 2 will come through as long as it’s the final output node in the workflow branch.
Make sure “Stream Response” is enabled in both agent node settings if you want streaming where it can work.
1 Like