inference
unload
Unload cached inference models.
strata inference unloaddb.ai.unload(model: 'Optional[str]' = None) -> 'Any'wire inference_unload
Removes cached model engines from the runtime to free memory. Pass a model spec to unload one entry, or omit it to unload every cached generation, embedding, and ranking model. The result reports whether any cached entry was actually removed. This affects only the in-memory runtime cache; it never deletes downloaded model files from disk.
To see the complete help for this command, run:
strata inference unload --helphelp(db.ai.unload)
Example
Evict cached models from the runtime (a no-op when nothing is loaded).
strata inference unloaddb.ai.unload()["unloaded"]Parameters
| Name | Type | Required | Description |
|---|---|---|---|
| model | string or null | no | Optional model spec. |
Returns
UnloadResult
- dataobject
- typestring
Errors
Recover by code. Retry policy and commit outcome come from the shipped error registry.
| Code | Retry | Commit outcome |
|---|---|---|
| failed_precondition.engine.runtime_closed | never | not_started |
| not_found.engine.branch | never | not_applicable |