703 B
703 B
DuckLM
DuckLM is a local agent runtime over local language models. It exposes a WebChat and HTTP API, calls llama-server through an OpenAI-compatible API, and persists tasks/events in SQLite.
Quick Start
python3 -m venv .venv
. .venv/bin/activate
python -m pip install -e ".[dev]"
cp .env.example .env
bash scripts/duck.sh start
Open http://127.0.0.1:8000/.
Useful commands:
bash scripts/duck.sh status
bash scripts/duck.sh logs --follow
bash scripts/duck.sh restart
bash scripts/duck.sh stop
MTP/speculative variant:
bash scripts/duck-mtp.sh start
bash scripts/duck-mtp.sh status
bash scripts/duck-mtp.sh logs --follow
bash scripts/duck-mtp.sh stop