Thanks for posting here and welcome to the community! 
What does the end of your workflow look like? If you use a Set Node for example you can specify a key value with the name of either text or output and set it to the AI response. The Agent will then pick that up and return only the response text.
Here’s an example of what I mean: