Repository navigation
How to connect to LLM compatible with OpenAI but OpenAI #1579
Description
I want to connect DeepInfra hosted models. They have OpenAI type connection. How to do that? For other softwares, only changing the OpenAI URL, Model and passing the key connects to the DeepInfra models
Reacted by Ming Fang, tkyggit, ksev548 and Chenjun Zou
Activity
waleedlatif1 commentedon Oct 8, 2025
@roy-sr hey, we are looking into allowing users to specify a custom base url, so we can re-use the openai library but use your own base url & model name
Jakdaw commentedon Nov 12, 2025
The 'Azure' provider already allows you to chose API base URL, but you'd still be stuck with static list of Azure model names.