Files
nixos-configs/machines
John Ogle 170a27310e
Some checks failed
CI / check (push) Failing after 1m44s
CI / build-and-cache (push) Has been skipped
feat(local-inference): add TTL support for automatic model unloading
Add globalTTL and per-model ttl options to llama-swap config,
allowing idle models to be automatically unloaded from memory.
2026-04-16 15:37:02 -07:00
..