AI Provider for llama.cpp

This plugin provides llama.cpp integration for the WordPress AI Client. It lets WordPress sites use large language models running via a llama.cpp server for text generation and other AI capabilities.

llama.cpp exposes an OpenAI-compatible API, and this provider uses that API to communicate with any GGUF model loaded into your llama.cpp server.

Features:

• Text generation with any llama.cpp-loaded model
• Automatic model discovery from your llama.cpp server
• Function calling support
• Structured output (JSON mode) support
• Settings page to configure the server URL (default: http://127.0.0.1:8080)
• Works without an API key for local instances

Requirements:

• PHP 7.4 or higher
• WordPress AI Client plugin must be installed and activated
• llama.cpp server running locally or on a remote host