Litellm

AI / LLMMIT41k stars

Call all LLM APIs using the OpenAI format

Deploy Litellm free Official site GitHub

Deploy with GoPanel:One-click deployAuto SSL certificatesScheduled backupsAny VPS provider

About Litellm

Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace Deploy Litellm on your own server with GoPanel.

Alternative to

OpenAI API

Azure OpenAI

Frequently asked questions

What is Litellm?: Litellm is a free, open-source ai / llm application licensed under MIT. It is a self-hosted alternative to OpenAI API, Azure OpenAI. Call all LLM APIs using the OpenAI format.
How do I self-host Litellm?: You can deploy Litellm on any VPS in seconds using GoPanel's one-click installer. GoPanel handles automatic SSL certificates, scheduled backups, and one-click updates — no manual server configuration required.
Is Litellm free to use?: Yes, Litellm is free and open-source software licensed under MIT. You can self-host it on your own server at no cost using GoPanel's free plan.
What is Litellm an alternative to?: Litellm is an open-source, self-hosted alternative to OpenAI API, Azure OpenAI. Unlike proprietary solutions, Litellm gives you full control over your data and infrastructure.

Deploy Litellm on your server

GoPanel makes self-hosting effortless. Deploy Litellm on any VPS in seconds with automatic SSL certificates, scheduled backups, and one-click updates — all included free.

Get started for free

App Details