Expose additional_instructions or [“tool_choice” : “required”]. in the “Message Assistant” operation of the OpenAI Node
My use case:
LLM is unable to answer time-context prompts unless fed datetime information in the prompt. OpenAI API exposes the additional_instructions field on the Create Run method. Add “tool_choice” option and force LLM to execute function via “tool_choice” : “required”
As described in this OpenAI API forum discussion, I can force the LLM to always call a function which will return the current date time. However, the OpenAI Node does not expose tool_choice option.
I think it would be beneficial to add this because:
This is a gap in OpenAI LLM functionality, and at this point, they have not solved this issue in the GPT LLMs. Until they do, my bot is unable to answer questions comparing dates, times, calendars, weeks, months, etc. b/c it lacks context of the current date/time in the user prompt.
Are you willing to work on this?
yes, need help setting up dev env.