John Ogle 170a27310e
Some checks failed
CI / check (push) Failing after 1m44s
CI / build-and-cache (push) Has been skipped
feat(local-inference): add TTL support for automatic model unloading
Add globalTTL and per-model ttl options to llama-swap config,
allowing idle models to be automatically unloaded from memory.
2026-04-16 15:37:02 -07:00
2026-04-08 11:47:11 -07:00
2026-04-08 11:47:11 -07:00
2026-04-08 11:47:11 -07:00
Description
No description provided
24 MiB
Languages
Nix 80.4%
Emacs Lisp 10.1%
Shell 6.2%
Python 3.3%