inference
cache_status
Report loaded model cache state.
strata inference cache-statusdb.ai.cache_status() -> 'Any'wire inference_cache_status
Reports the runtime model cache as three lists of specs: the generation, embedding, and ranking models currently loaded in memory. Use it to check what is resident before generating, or to confirm that `inference unload` freed the models you expected. The lists reflect only in-memory engines, not models available on disk.
To see the complete help for this command, run:
strata inference cache-status --helphelp(db.ai.cache_status)
Example
Inspect which models are currently loaded in the runtime cache.
strata inference cache-statusdb.ai.cache_status()["generation_models"]Returns
ModelCacheStatus
- dataModelCacheStatus
- typestring
Errors
Recover by code. Retry policy and commit outcome come from the shipped error registry.
| Code | Retry | Commit outcome |
|---|---|---|
| failed_precondition.engine.runtime_closed | never | not_started |
| not_found.engine.branch | never | not_applicable |