Popular repositories Loading

1. new-api new-api Public

   Forked from QuantumNous/new-api

   AI模型接口管理与分发系统，支持将多种大模型转为OpenAI格式调用、支持Midjourney Proxy、Suno、Rerank，兼容易支付协议，可供个人或者企业内部管理与分发渠道使用，本项目基于One API二次开发。🍥 The next-generation LLM gateway and AI asset management system supports multiple lan…

   Go

2. sglang sglang Public

   Forked from sgl-project/sglang

   SGLang is a fast serving framework for large language models and vision language models.

   Python 1

3. llm_perf llm_perf Public

   Python

4. Mooncake Mooncake Public

   Forked from kvcache-ai/Mooncake

   Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

   C++

5. sglang-toolkit sglang-toolkit Public

   Shell

6. sglang-fzyzcjy sglang-fzyzcjy Public

   Forked from fzyzcjy/sglang

   SGLang is a fast serving framework for large language models and vision language models.

   Python