LiteLLM Documentation

Welcome to the LiteLLM documentation. This service provides a unified interface to various Large Language Models (LLMs).

For Users and Developers

If you are a developer looking to connect your application to LiteLLM, please refer to the User Guide. This guide provides detailed instructions on how to configure your application, with examples for different programming languages and libraries.

For Administrators

If you are an administrator responsible for deploying and managing the LiteLLM service, please refer to the Admin Guide. This guide covers deployment procedures, configuration details, architecture overview, and troubleshooting tips.

Adding New Providers

To expose an additional LLM vendor through LiteLLM, follow the New Provider Guide for the required secret, ArgoCD, and model routing changes.