Resource detail

vLLM

高吞吐 LLM 推理引擎，生产环境部署首选。

GlobalFree

Visit official siteMore like this

At a glance

vllm

Pricing

Free

Access

No login

Platforms

Python · Linux · Self-hosted

Chinese support

Last checked

2026-08-28

Popularity

85/100

Typical use

生产推理服务私有化 API

Related resources

Selected by use case

Hugging Face

全球最大的开源模型与数据集社区。

GlobalFreemiumModel hub+2

Updated 2026-08-28

Visit official site

Ollama

一条命令在本地运行开源大模型的工具。

GlobalFreeLocal deployment+1

Updated 2026-08-28

Visit official site

llama.cpp

A lightweight C/C++ inference framework that runs large models on consumer hardware.

GlobalFreeOpen source+2

Updated 2026-07-09

Visit official site

ComfyUI

节点式图像视频生成工作流工具，可控性极强。

GlobalFreeImage+1

Updated 2026-08-28

Visit official site

Stable Diffusion WebUI

A classic local image-generation interface with a large plugin ecosystem.

GlobalFreeOpen source+2

Updated 2026-07-09

Visit official site

Open WebUI

A self-hosted AI chat interface that connects to Ollama and any API.

GlobalFreeOpen source+2

Updated 2026-07-09

Visit official site