Gemini API Proxy and Load Balancer Applications

By /

The Gemini API proxy and Load Balancer application developed based on Python FastAPI provides multiple Gemini API key management, Load Balancer, authentication, model filtering, status monitoring and other functions. It also supports proxy functions in the OpenAI API format, as well as image generation and upload functions.

Project introduction

The project allows users to manage multiple Gemini API keys through simple configuration, enabling key rotation, authentication, model filtering, and status monitoring.

Main functions

  • Multi-key Load Balancer: Support the configuration of multiple Gemini API keys, automatic polling, and improve availability and concurrency.
  • visualization configuration: Modifying the configuration through the management background can take effect without restarting the service.
  • OpenAI API compatible: Supports proxy in OpenAI API format for easy integration.
  • Image generation and upload: Integrated image generation and multi-image transmission functions.
  • condition monitoring: Provide a key status page to monitor key usage in real time.

Project structure

The project structure is clear and mainly includes the following directories:

  • app/config/: Configuration Management
  • app/core/: Core application logic
  • app/database/: Database models and connections
  • app/router/: API Routing
  • app/service/: Business Logic Services
  • app/templates/: HTML template

Deployment method

The project provides Docker support, and users can quickly deploy services through Docker containers.

📌Precautions

The project adopts a CC BY-NC 4.0 (Signature-Non-Commercial Use) license and prohibits any form of commercial resale of services.

Github：https://github.com/snailyp/gemini-balance


Oil tubing:

Scroll to Top