Improving LLM prefill on the NVIDIA GeForce RTX 4060 mobile

The Acer Nitro V15 has a discrete nvidia GeForxe RTX 4060 mobile. Turns out, the default firmware leaves some performance untapped [GPU].1. follow the project instructions [GPU] to download, build and install.2. specifically, the 4060m requires a kernel parameter in grub: "gpu_unlock.targets=0000:01:00.0 gpu_unlock.ad107_experimental=1"You'll have to find the exact address with lspci. Yes, it needs the … Continue reading Improving LLM prefill on the NVIDIA GeForce RTX 4060 mobile →