inference

models.list

List catalog inference models.

strata inference models list

wire inference_models_list

Lists every model in Strata's built-in catalog as a terminal page. Each entry reports the model's task (embed, generate, or rank), architecture, default quantization, embedding dimension, HuggingFace repository, approximate artifact size, and whether the model artifact is already present in the local model directory. Use `inference models local` to see only the downloaded models, or `inference models pull` to fetch one.

To see the complete help for this command, run:

strata inference models list --help

Example

List the built-in model catalog (spans embedding, generation, ranking).

strata inference models listminiLM	embed	bert	f16	unavailable	45 MBnomic-embed	embed	nomic-bert	q8_0	unavailable	260 MBbge-m3	embed	xlm-roberta	q8_0	unavailable	1.2 GBgemma-embed	embed	gemma3	q8_0	unavailable	320 MBgpt2	generate	gpt2	q8_0	unavailable	178 MBtinyllama	generate	llama	q4_k_m	unavailable	670 MBqwen3:1.7b	generate	qwen3	q8_0	unavailable	2 GBgemma3:1b	generate	gemma3	q4_k_m	unavailable	780 MBphi3.5	generate	phi3	q4_k_m	unavailable	2.4 GBllama3.1:8b	generate	llama	q4_k_m	unavailable	4.6 GBqwen3:8b	generate	qwen3	q4_k_m	unavailable	4.7 GB11 model(s) unavailable: this build cannot run local models -- a bare name like these means a local model. Add local execution with `strata inference install-local`, or name a cloud model instead (`openai:<model>`, `google:<model>`, `anthropic:<model>`).

Returns

Page<ModelInfo>

  • dataobject

    Shared pagination continuation facts.

  • typestring

Errors

Recover by code. Retry policy and commit outcome come from the shipped error registry.

CodeRetryCommit outcome
failed_precondition.engine.runtime_closednevernot_started
not_found.engine.branchnevernot_applicable
← All 12 Inference commands

agents: this page as markdown → /docs/reference/inference/models/list.md