Self hosted LLM
The idea is:
Most organizations are now self hosting models from OpenAI, Gemini, DeepSeek etc to use them to process company specific data. Most often, we cannot use public models to process confidential data due to compliance.
My use case:
In our organization, we have locally hosted models from OpenAI, Gemini etc to which we have to use custom authentication to connect to it. The HTTP node would work, but we cannot connect this node to the AI Agent. Our requirement is to use the self hosted LLMs in our workflows and AI agent to process confidential data.
I think it would be beneficial to add this because:
Self hosted LLMs can be used by enterprises
Any resources to support this?
N/A
Are you willing to work on this?
No. I am not from a programming background