Ryzen AI ミニPCでローカルLLMを実用速度で動かす完全ガイド（2026年版） The Complete Guide to Running a Local LLM at Usable Speed on a Ryzen AI Mini PC (2026 Edition)

Introduction

Mini PCs with Ryzen AI have an integrated GPU (Radeon 890M) and a lot of memory, which makes them a popular machine for running local LLMs. But if you install things without thinking, inference ends up running on the CPU, and it’s too slow to be useful.

In this series, I wiped my environment clean, rebuilt it, and measured speed and quality along the way. This post is a step-by-step guide to reproduce those results as quickly as possible. I leave the detailed reasoning to the individual posts.

Where you end up: Qwen3.6-35B-A3B at 17.5–22.6 tokens per second. That’s about 7× the old setup (CPU inference). Type llm "question" in the terminal, and even if the server is stopped, it starts automatically and the answer comes back.

Tested Environment

The steps and numbers in this post were verified on b11026. A newer version (b11193) is available on winget, but I haven’t tried it. Updating may change the options or the speed.

1. Clean Up the Old Environment

If you previously installed Ollama, LM Studio, Lemonade or similar, stop and remove them first. They compete for the same GPU and memory, so if they’re still around, the speed won’t be stable.

• Stop resident services (tray icons, Windows services)
• Delete old model caches (such as Hugging Face’s ~\.cache\huggingface) as needed

If you want to confirm the effect by looking at free space after deleting, pause syncing such as OneDrive first. On my machine, I deleted 69 GB and free space went down by 150 GB. OneDrive was writing 6 GB per minute in the background.

Details are in the cleanup post.

2. Install llama.cpp (Vulkan Build)

winget install --id ggml.llamacpp

After installing, reopen the terminal. A terminal that was already open still has the old PATH, so it says llama-server can’t be found (I misdiagnosed this as “not installed”).

Check that the GPU is visible.

llama-server --list-devices

Available devices:
  Vulkan0: AMD Radeon(TM) 890M Graphics (78739 MiB, 74802 MiB free)

If the 890M shows up as Vulkan0, you’re ready.

Why Vulkan? Comparing generation speed on the same model, CPU was 2.59 t/s, ROCm 4.76 t/s, and Vulkan 13.41 t/s. On this machine, Vulkan is by far the fastest.

3. Choose a Model

Choose an MoE (Mixture of Experts) model. This is the biggest decision.

The MoE model, despite the bigger file, is 5.7× faster. On an iGPU, generation speed is almost entirely set by how fast weights are read from memory (bandwidth), and an MoE model reads only part of the whole for each token. Choose by “how many bytes are read per token”, not by “total parameter count”.

Qwen3.6-35B-A3B has builds that include MTP (layers for speculative decoding). The settings below use it, so pick the -MTP-GGUF version.

4. Start the Server

llama-server -hf unsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL `
  --port 8080 -c 65536 -ngl 99 -b 8192 -fa on --kv-unified --jinja `
  --no-mmproj --spec-type draft-mtp --spec-draft-n-max 2 `
  --sleep-idle-seconds 43200

The first run downloads about 22 GB. After that, it just reads from the cache.

There are also options that don’t help. -ub is flat, --cache-reuse doesn’t work with this model, and -ctv q8_0 (V quantization) makes it slower. The full list is in the post on what helps and what doesn’t.

Check That It Works

Open http://127.0.0.1:8080 in a browser and you can use the chat screen that comes with llama.cpp. It also exposes an OpenAI-compatible API, so most tools can connect if you point them at http://127.0.0.1:8080/v1.

5. Make It Usable by Just Typing llm

Starting the server every time is a chore, so I put a function that starts it automatically if it’s stopped in my PowerShell profile.

notepad $PROFILE

Paste in the following function.

function llm {
  param([Parameter(Mandatory)][string]$Prompt, [int]$Port = 8080)
  $url = "http://127.0.0.1:$Port"
  $ready = { try { (Invoke-WebRequest "$url/health" -TimeoutSec 2 -SkipHttpErrorCheck).StatusCode -eq 200 } catch { $false } }
  if (-not (& $ready)) {
    Write-Host 'サーバを起動しています（初回は 40 秒ほど）...'
    $a = @('-hf','unsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL','--port',"$Port",'-c','65536','-ngl','99',
           '-b','8192','-fa','on','--kv-unified','--jinja','--no-mmproj',
           '--spec-type','draft-mtp','--spec-draft-n-max','2','--sleep-idle-seconds','43200')
    Start-Process llama-server -ArgumentList $a -WindowStyle Hidden
    while (-not (& $ready)) { Start-Sleep 2 }
  }
  $body = @{ model = 'local'; messages = @(@{ role = 'user'; content = $Prompt })
             chat_template_kwargs = @{ enable_thinking = $false } } | ConvertTo-Json -Depth 5
  $r = Invoke-RestMethod "$url/v1/chat/completions" -Method Post -ContentType 'application/json; charset=utf-8' `
         -Body ([Text.Encoding]::UTF8.GetBytes($body))
  $r.choices[0].message.content
}

Try it in a new terminal.

llm "1+1は？数字だけ答えて"

On my machine, the first call with the server stopped took 26 seconds (including startup), and the second took 1.0 second. I verified this on PowerShell 7 (-SkipHttpErrorCheck is an option from 7 onward).

This function is the bare minimum. Streaming the response, an interactive mode, stopping the server and so on are built in the CLI post.

Thinking is turned off (enable_thinking = $false). For routine questions, turning thinking on didn’t change the accuracy and tripled the time (the thinking post).

6. Common Stumbling Points

These are only the ones I actually ran into.

The first row matters most. Wherever you’ve written localhost, change it all to 127.0.0.1.

If You Work With Long Documents

With these same settings, you can extend the context up to 256K (memory stays within 28 GiB). There are caveats, though.

• Reading is heavy: feeding in a 128K-token document takes 18–24 minutes
• It’s fast from the second time: asking a different question about the same document only rereads the end, in 11 seconds
• Put the document first and the question after. Rewriting the middle means rereading everything

For details, see the 128K post and the cache post.

Summary

1. Stop and clean up the old environment
2. Install the Vulkan build with winget install --id ggml.llamacpp, then reopen the terminal
3. Choose an MoE model (the MTP version of Qwen3.6-35B-A3B)
4. Start it with -b 8192, MTP (n-max 2) and --no-mmproj
5. Put the llm function in your profile and connect via 127.0.0.1

Two things decide the speed: using Vulkan and choosing MoE. Think of the finer settings as adding another 10–30% on top of that.