[zix790prors] More local LLM updates

Using qwen3:30b explicitly. The default "qwen3" from ollama was pulling
a very outdated model apparently (qwen3:8b). qwen3:4b and qwen3:30b are the newest.

Also sets up some defaults for gptel that have been useful
This commit is contained in:
2025-09-11 08:39:36 -07:00
parent 6bf0a37533
commit 56b1111f54
2 changed files with 14 additions and 8 deletions

View File

@@ -71,9 +71,11 @@ with lib;
powerManagement.finegrained = false;
};
environment.systemPackages = [
(pkgs.ollama.override { acceleration = "cuda"; })
];
services.ollama = {
enable = true;
acceleration = "cuda";
loadModels = [ "gpt-oss" "deepseek-r1" "qwen3:30b" ];
};
# This option defines the first version of NixOS you have installed on this particular machine,
# and is used to maintain compatibility with application data (e.g. databases) created on older NixOS versions.