You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Having a OpenAI compatible endpoints would make it easier for developers to use different models with the same code base.
Describe the solution you'd like
Beyond just having the compatible endpoints, it should also be payload compatible for things like function calling and image upload. I've seen the Json payload vary for both of those with different open-source models.
Describe alternatives you've considered
Using a tool like LiteLLM to host the OpenAI compatible endpoints is what I use now, and it works with any models I can host with Ollama, for example.
The text was updated successfully, but these errors were encountered:
Having a OpenAI compatible endpoints would make it easier for developers to use different models with the same code base.
Describe the solution you'd like
Beyond just having the compatible endpoints, it should also be payload compatible for things like function calling and image upload. I've seen the Json payload vary for both of those with different open-source models.
Describe alternatives you've considered
Using a tool like LiteLLM to host the OpenAI compatible endpoints is what I use now, and it works with any models I can host with Ollama, for example.
The text was updated successfully, but these errors were encountered: