vrr/openclaw
2
0
Fork 0
mirror of https://github.com/openclaw/openclaw.git synced 2026-10-22 23:17:38 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 32
openclaw/docs/plugins/reference/llama-cpp.md
Patrick Erichsen d6d7435f59
feat(plugins): default package installs to ClawHub (#173669) 
* feat(plugins): default unprefixed packages to ClawHub

Use the shared source planner for CLI, chat, and assistant installs. Keep explicit npm and local sources, preserve canonical built-in shortcuts, and retain the selected registry in update and repair records.

Autoreview findings addressed:
- [P2] Preserve ClawHub provenance in search hints that match aliases
  Route scoped packages through ClawHub and add @latest to ambiguous unscoped search hints.
- [P2] Preserve usable search hints for scoped names with file suffixes
  Treat file-suffixed package names as registry specs, migrate source-selection tests, and retain npm in retry guidance.
- [P2] Update the remaining source-selection test expectations
  Treat file-suffixed package names as registry specs, migrate source-selection tests, and retain npm in retry guidance.
- [P2] Keep npm prerelease retry hints on npm
  Treat file-suffixed package names as registry specs, migrate source-selection tests, and retain npm in retry guidance.
- [P2] Restrict catalog shortcuts to canonical plugin IDs
  Restrict bare shortcuts to canonical IDs and retain npm in shared hook-pack prerelease guidance.
- [P2] Preserve npm in hook-pack prerelease guidance
  Restrict bare shortcuts to canonical IDs and retain npm in shared hook-pack prerelease guidance.

* docs(plugins): show ClawHub as the default install source

Update setup examples and generated inventory instructions to omit the ClawHub prefix. Document explicit npm selection and canonical plugin-ID shortcuts.

* fix(plugins): keep recovery tied to the selected source

* test(plugins): cover search commands and saved registry choices

* test(plugins): align pre-action recovery with selected sources

* test(plugins): prove source-bound recovery through the CLI

* fix(plugins): retain official identity during config recovery
2026-10-16 22:07:52 +00:00

1.7 KiB
Raw Permalink Blame History

summary read_when title
Managed and external llama.cpp servers for GGUF chat, embeddings and local images.
You are installing, configuring, or auditing the llama-cpp plugin
Llama Cpp plugin reference

Managed and external llama.cpp servers for GGUF chat, embeddings and local images.

Distribution

  • Package: @openclaw/llama-cpp-provider
  • Install route: npm or ClawHub: @openclaw/llama-cpp-provider

Surface

  • Providers: llama-cpp
  • Contracts: embeddingProviders, mediaUnderstandingProviders, tools

Managed text models

During interactive setup, OpenClaw installs a pinned, verified llama-server and recommends a model for the Gateway host's available memory, GPU, and disk space. Recommendations start with Qwen3.5 4B (about 2.7 GB) on eligible 8 GiB hosts and scale up as hardware permits. See the current model recommendations for sizes and selection floors.

To use another model, configure params.modelPath, select its llama-cpp/<id> reference, and rerun managed setup. Setup uses that authored route and offers to download it if needed. Custom models are not subject to recommendation memory floors. Existing cached GGUFs remain supported; local memory search can also use embedding-only setup.

Related docs