508 B
508 B
Model Roles
Roles are logical, not physical. thinker, critic, coder, action, and summary may all point to the same model.
Each role can differ by prompt, temperature, output limit, response format, schema, memory scope, and endpoint. Request-level parameters can change per call. Backend-level parameters such as GGUF path, context size, GPU offload, MTP, and server port require the backend to be started with the desired settings.
See config/models.yaml for one model mapped to all roles.