Together.ai provides a inference api at verry low price compared to openai.
With the new open source model Mixtral 8x7b it would be a great solution!
Together.ai has a openai compatible api so it is possible to change the baseurl but this is actually resolving in bugs:
“500 “(unknown path)\n Error: Unable to call
raise_exception, which is undefined or falsey””