ducklm/README.md

34 lines
703 B
Markdown

# DuckLM
DuckLM is a local agent runtime over local language models. It exposes a WebChat and HTTP API, calls `llama-server` through an OpenAI-compatible API, and persists tasks/events in SQLite.
## Quick Start
```bash
python3 -m venv .venv
. .venv/bin/activate
python -m pip install -e ".[dev]"
cp .env.example .env
bash scripts/duck.sh start
```
Open `http://127.0.0.1:8000/`.
Useful commands:
```bash
bash scripts/duck.sh status
bash scripts/duck.sh logs --follow
bash scripts/duck.sh restart
bash scripts/duck.sh stop
```
MTP/speculative variant:
```bash
bash scripts/duck-mtp.sh start
bash scripts/duck-mtp.sh status
bash scripts/duck-mtp.sh logs --follow
bash scripts/duck-mtp.sh stop
```