An open source project that unifies API input and output, exception handling, and Load Balancer operations for more than 100 LLMs such as Bedrock, Azure, OpenAI, Cohere, Anthropic, Olama, Sagemaker, HuggingFace, and Replicate. Currently 7.5K Starˇ
At the same time, LiteLLM is also an entrepreneurial project of YC W23:https://ycombinator.com/companies/berriai
Video: