LiteLLM

🇻🇳 Đọc bằng tiếng Việt

LiteLLM — A gateway to 100+ AI models through one unified calling format, with cost tracking and load balancing.

What is LiteLLM?

LiteLLM is an open-source app on GitHub (BerriAI/litellm). A gateway to 100+ AI models through one unified calling format, with cost tracking and load balancing.

What can LiteLLM do?

• Call many AI models with the same code
• Track costs, set limits, balance load
• Run it as a proxy shared by the whole team

How to install LiteLLM

See the ⚡ Quick install section at the top of the page — it has a ready-to-copy command taken from the author’s README, plus where to run it. For the full instructions, see the README at the end of the page.

Frequently asked questions about LiteLLM

Is LiteLLM free?

Yes. LiteLLM is an open-source project on GitHub, so you can download and use it for free.

Is LiteLLM hard to install?

No. You only need to run one command above.

Download & source code

The source code, README and latest updates of LiteLLM are at github.com/BerriAI/litellm. The star count and update date on this page sync automatically from GitHub.

📖 Full guide

🔗 Related repos