Resource detail

llama.cpp

A lightweight C/C++ inference framework that runs large models on consumer hardware.

GlobalFreeOpen source

Visit official siteMore like this

At a glance

llama-cpp

Pricing

Free

Access

No login

Platforms

Mac · Windows · Linux · Cli

Chinese support

Last checked

2026-07-09

Popularity

82/100

Typical use

低配设备推理嵌入式集成

Similar tools and resources

Selected by use case

Ollama

一条命令在本地运行开源大模型的工具。

GlobalFreeLocal deployment+1

Updated 2026-08-28

Visit official site

vLLM

高吞吐 LLM 推理引擎，生产环境部署首选。

GlobalFreeInference engine+1

Updated 2026-08-28

Visit official site

Hugging Face

全球最大的开源模型与数据集社区。

GlobalFreemiumModel hub+2

Updated 2026-08-28

Visit official site

ComfyUI

节点式图像视频生成工作流工具，可控性极强。

GlobalFreeImage+1

Updated 2026-08-28

Visit official site

Stable Diffusion WebUI

A classic local image-generation interface with a large plugin ecosystem.

GlobalFreeOpen source+2

Updated 2026-07-09

Visit official site

Open WebUI

A self-hosted AI chat interface that connects to Ollama and any API.

GlobalFreeOpen source+2

Updated 2026-07-09

Visit official site