[zix790prors] More local LLM updates
Using qwen3:30b explicitly. The default "qwen3" from ollama was pulling a very outdated model apparently (qwen3:8b). qwen3:4b and qwen3:30b are the newest. Also sets up some defaults for gptel that have been useful
This commit is contained in:
@@ -71,9 +71,11 @@ with lib;
|
||||
powerManagement.finegrained = false;
|
||||
};
|
||||
|
||||
environment.systemPackages = [
|
||||
(pkgs.ollama.override { acceleration = "cuda"; })
|
||||
];
|
||||
services.ollama = {
|
||||
enable = true;
|
||||
acceleration = "cuda";
|
||||
loadModels = [ "gpt-oss" "deepseek-r1" "qwen3:30b" ];
|
||||
};
|
||||
|
||||
# This option defines the first version of NixOS you have installed on this particular machine,
|
||||
# and is used to maintain compatibility with application data (e.g. databases) created on older NixOS versions.
|
||||
|
||||
Reference in New Issue
Block a user