Langchain Model add provides a inference api at verry low price compared to openai.
With the new open source model Mixtral 8x7b it would be a great solution! has a openai compatible api so it is possible to change the baseurl but this is actually resolving in bugs:
“500 “(unknown path)\n Error: Unable to call raise_exception, which is undefined or falsey””