38 lines
901 B
Markdown
38 lines
901 B
Markdown
# DuckLM
|
|
|
|
DuckLM is a local agent runtime over local language models. It exposes a WebChat and HTTP API, calls `llama-server` through an OpenAI-compatible API, and persists tasks/events in SQLite.
|
|
|
|
## Quick Start
|
|
|
|
```bash
|
|
python3 -m venv .venv
|
|
. .venv/bin/activate
|
|
python -m pip install -e ".[dev]"
|
|
cp .env.example .env
|
|
bash scripts/duck.sh start
|
|
```
|
|
|
|
Open `http://127.0.0.1:8000/`.
|
|
|
|
`duck.sh` starts and stops the local Qdrant vector memory service together with
|
|
`llama-server` and the DuckLM API. Use `status --probe` for live backend checks.
|
|
|
|
Useful commands:
|
|
|
|
```bash
|
|
bash scripts/duck.sh status
|
|
bash scripts/duck.sh status --probe
|
|
bash scripts/duck.sh logs --follow
|
|
bash scripts/duck.sh restart
|
|
bash scripts/duck.sh stop
|
|
```
|
|
|
|
MTP/speculative variant:
|
|
|
|
```bash
|
|
bash scripts/duck-mtp.sh start
|
|
bash scripts/duck-mtp.sh status
|
|
bash scripts/duck-mtp.sh logs --follow
|
|
bash scripts/duck-mtp.sh stop
|
|
```
|