inference

capability

Report capabilities for a model spec.

strata inference capability

wire inference_model_capability

Parses a model spec into a provider and model name and reports what that combination supports without running the model. The result states whether generation, tokenization, embedding, and ranking are available, whether the operation requires network access or an API key, whether this binary was compiled with the provider feature needed to execute, whether the runtime currently permits network calls, and the known embedding dimension. Model specs are catalog names (`tinyllama`), catalog `name:quant` pairs (`tinyllama:q8_0`), local GGUF paths, or provider specs (`anthropic:claude-...`).

To see the complete help for this command, run:

strata inference capability --help

Example

Report a model's capabilities without a network call.

strata inference capability openai:gpt-4o-mini  # Pure metadata - no request is sent to the provider.provider                  openaimodel                     gpt-4o-miniavailability              readycan_generate              truecan_embed                 truecan_rank                  falsecan_tokenize              falseembedding_dim             0requires_api_key          truerequires_network          truenetwork_enabled           trueprovider_feature_enabled  truesupports_tools            truesupports_json_object      truesupports_json_schema      truesupports_logprobs         true

Parameters

NameTypeRequiredDescription
modelstringyesModel spec.

Returns

InferenceCapability

  • dataInferenceCapability
  • typestring

Errors

Recover by code. Retry policy and commit outcome come from the shipped error registry.

CodeRetryCommit outcome
failed_precondition.engine.runtime_closednevernot_started
not_found.engine.branchnevernot_applicable
inference.invalid_requestnevernot_applicable
inference.io_failureafter_state_changenot_applicable
← All 12 Inference commands

agents: this page as markdown → /docs/reference/inference/capability.md