Real time voice agent connected to a database

[JSY]

So, I’m trying to build a Customer Service Assistant connected to a database, utilising Twilio, ElevenLabs, Supabase, + 4o >> However, I can’t seem to make the workflow work.

So far, this is where the execution gets me;

Every time I call my Twilio number - the Workflow pops, but no audio is transmitted back to the call, or even to ElevenLabs. I’ve gone round in circles asking LLM’s to fix this, but it just hasn’t worked. Every suggestion they’ve asked me to doesn’t really work and there’s another problem waiting for me on the other side.

I’ve made sure the ports are all connected, that wsproxy is correctly coded, that the calls get connected via the WS; so really unsure how to go forward.

it seems to get stuck in this node, where it doesn’t pass the information through.

the audio always seems to go into ‘false branch’ and I don’t know why. The WS is connected, but the calls are silent. I can’t hear anything. and it seems neither can the workflow.

It seems the audio isn’t even being passed through.

PLEASE any help would be greatly appreciated, this is giving me brain damage

Thank you so much in advance if you can help me crack this.

WARMEST, JSY <3

[JSY]

So i’ve actually managed to solve that issue above now, and I’ve ran into another one.

When I send the audio/mulaw file with model_id: ‘scribe_v1’, 11Labs API responds with a 400 error with the message: “File audio.mulaw is corrupted. Please ensure it is playable audio.”

When I try to use the eleven_multilingual_v2 model, which is better suited for telephony audio, 11Labs API responds with a 400 error with the message: “‘eleven_multilingual_v2’ is not a valid model_id. Only ‘scribe_v1’ and ‘scribe_v1_experimental’ are currently available.”

So now it’s an audio file problem and again, I’m unsure how to fix!