What is LPDDR5?
Low-Power DDR5 — faster than LPDDR4, common in mid-range mini PCs (2023–2025). Provides 68–85 GB/s bandwidth, enabling noticeably better CPU inference speeds than LPDDR4 systems.
Full Explanation
LPDDR5 (Low-Power DDR5) is the memory standard used in mid-to-upper-range mini PCs released from 2023 onwards. Operating at 68–85 GB/s bandwidth, it delivers roughly 30–60% more memory throughput than LPDDR4, which directly translates to 30–60% more tokens per second in CPU inference. Mini PCs like the Geekom A6 and GMKtec M6 Ultra use LPDDR5 or LPDDR5X, enabling 10–16 t/s on 7B models compared to 6–8 t/s on LPDDR4 systems.
Why It Matters for Local AI
When evaluating mini PCs for local AI, LPDDR5 vs LPDDR4 is a meaningful spec. It's the difference between a system that feels responsive for short prompts and one that feels sluggish. If a mini PC lists LPDDR4 memory in 2024–2025, it's using older hardware that will underperform on LLM inference.
Hardware Relevant to LPDDR5
mini-pc · Check Price on Amazon · 16 GB Unified · 68 GB/s
mini-pc · Check Price on Amazon · 32 GB Unified · 68 GB/s
mini-pc · Check Price on Amazon · 16 GB Unified · 51 GB/s
Related Terms
Memory Bandwidth→
How fast data moves between memory and the processor, measured in GB/s. Tokens per second scales nearly linearly with bandwidth — this is the single most important GPU spec for LLM speed.
CPU Inference→
Running LLMs on the CPU rather than a GPU. Works on any hardware, no special drivers needed. Limited to ~8–12 t/s on 7B models — fine for background tasks, slow for interactive use.
LPDDR4→
Low-Power DDR4 — often soldered memory in mini PCs. Lower bandwidth than desktop DDR4 or DDR5. Limits tokens-per-second compared to high-end alternatives.
Tokens/s→
Tokens per second — the standard speed metric for LLMs. One token ≈ 0.75 words. Above 10 t/s feels interactive; below 5 t/s feels like watching paint dry.