ducklm/README.md

DuckLM

DuckLM is a local agent runtime over local language models. It exposes a WebChat and HTTP API, calls llama-server through an OpenAI-compatible API, and persists tasks/events in SQLite.

Quick Start

python3 -m venv .venv
. .venv/bin/activate
python -m pip install -e ".[dev]"
cp .env.example .env
bash scripts/duck.sh start

Open http://127.0.0.1:8000/.

duck.sh starts and stops the local Qdrant vector memory service together with llama-server and the DuckLM API. Use status --probe for live backend checks.

Useful commands:

bash scripts/duck.sh status
bash scripts/duck.sh status --probe
bash scripts/duck.sh logs --follow
bash scripts/duck.sh restart
bash scripts/duck.sh stop

MTP/speculative variant:

bash scripts/duck-mtp.sh start
bash scripts/duck-mtp.sh status
bash scripts/duck-mtp.sh logs --follow
bash scripts/duck-mtp.sh stop