This plugin provides llama.cpp integration for the WordPress AI Client. It lets WordPress sites use large language models running via a llama.cpp server for text generation and other AI capabilities.
llama.cpp exposes an OpenAI-compatible API, and this provider uses that API to communicate with any GGUF model loaded into your llama.cpp server.
Features:
- Text generation with any llama.cpp-loaded model
- Automatic model discovery from your llama.cpp server
- Function calling support
- Structured output (JSON mode) support
- Settings page to configure the server URL (default: http://127.0.0.1:8080)
- Works without an API key for local instances
Requirements:
- PHP 7.4 or higher
- WordPress AI Client plugin must be installed and activated
- llama.cpp server running locally or on a remote host