inference
unload
Unload cached inference models.
strata inference unloaddb.ai.unload(model: 'Optional[str]' = None) -> 'Any'wire inference_unload
Removes cached model engines from the runtime to free memory. Pass a model spec to unload one entry, or omit it to unload every cached generation, embedding, and ranking model. The result reports whether any cached entry was actually removed. This affects only the in-memory runtime cache; it never deletes downloaded model files from disk.
To see the complete help for this command, run:
strata inference unload --helphelp(db.ai.unload)
Example
Evict cached models from the runtime (a no-op when nothing is loaded).
strata inference unloadno cached entry
db.ai.unload()["unloaded"]Parameters
| Name | Type | Required | Description |
|---|---|---|---|
| model | string or null | no | Optional model spec. |
Returns
InferenceUnloadResult
- dataInferenceUnloadResult
- typestring
Errors
Recover by code. Retry policy and commit outcome come from the shipped error registry.
| Code | Retry | Commit outcome |
|---|---|---|
| failed_precondition.engine.runtime_closed | never | not_started |
| not_found.engine.branch | never | not_applicable |