# Local LLM Laptop Guide — Best Models Without a $10k Mac Studio
> **TL;DR:** Paul Couvert (@itsPaulAi) lists the best local models for laptop-class hardware. Top picks: Qwen3.6-27B for coding, Gemma 4 12B for everyday tasks, Parakeet 0.6B v3 for voice-to-text, Gemma 4 E4B for phone-class edge inference, and Gemma 4 26B diffusion for maximum tok/s. Key tips: use Unsloth quantized versions, run via LM Studio or llama.cpp, try Google AI Edge Gallery on mobile. Complements Jun Song's MLX MoE optimization post — both converge on the Qwen3.6-35B-A3B MoE variant.
## Source
| Source | Author | Date | Engagement |
|--------|--------|------|------------|
| [X-Post: "Best local models on a laptop"](https://x.com/itsPaulAi/status/2071717503105900993) | Paul Couvert (@itsPaulAi) | 2026-06-29 | 138 likes, 12 reposts, 170 bookmarks, ~13.5K views |
| **Cross-ref** | Jun Song warns: slow on Mac/MLX | Jun Song's MoE preference aligns |
> **⚠️ Tension with Jun Song:** Jun Song explicitly says dense 27B on Mac is "painfully slow." Paul recommends it for coding on any laptop — likely assuming Unsloth quantization on non-Mac hardware. The **MoE variant (35B-A3B)** is where both agree: it's the faster, better-suited option for constrained hardware. See [resolution below](#resolving-the-dense-27b-tension).
### 2. Everyday Tasks: Gemma 4 12B
| Dimension | Detail |
|-----------|--------|
| **Size** | 12B |
| **Best for** | Everyday tasks and questions |
| **Why** | Balanced size-to-quality ratio for general use |
| **Runtime** | LM Studio, llama.cpp, or Google AI Edge Gallery |
### 3. Voice-to-Text: Parakeet 0.6B v3
| Dimension | Detail |
|-----------|--------|
| **Size** | 0.6B — tiny |
| **Best for** | Speech-to-text (STT) |
| **Claim** | "Basically the best voice-to-text model you can find" |
| **Relevance** | Local Whisper alternative; relevant for OpenClaw voice interaction pipelines |
| **Edge fit** | Small enough to run on any laptop or phone |
### 4. Edge / Phone: Gemma 4 E4B
| Dimension | Detail |
|-----------|--------|
| **Size** | ~4B |
| **Best for** | On-device inference, offline phone use |
| **Claim** | "Surprisingly good for the size" |
| **Mobile deployment** | Google AI Edge Gallery (iOS/Android) |
| **Cross-ref** | Extends [Cloud-Exit thesis](../hardware/cloud-exit-and-local-superiority.md) to mobile — connects to [OpenClaw mobile apps](../../tools/openclaw.md) |
### 5. Speed Champion: Gemma 4 26B Diffusion
| Dimension | Detail |
|-----------|--------|
| **Size** | 26B |
| **Type** | Diffusion-based LLM |
| **Best for** | Maximum tok/s on local hardware |
| **Claim** | "The most tok/s you can have with a local model" |
| **Architecture note** | Diffusion LLMs generate tokens via iterative denoising — different paradigm from standard AR models. See [[post-transformer-llm-architectures.md]] for DeepMind's diffusion LLM research (10× efficiency gains). |
---
## Practical Deployment Tips
### Quantization: Unsloth
[Unsloth](https://github.com/unslothai/unsloth) provides quantized model versions optimized for laptop deployment:
| [llama.cpp](https://github.com/ggerganov/llama.cpp) | CLI / library | Maximum control, minimal overhead, embedding in apps |
| [Google AI Edge Gallery](https://ai.google.dev/edge) | Mobile app | On-device inference on iOS/Android |
---
## Resolving the Dense 27B Tension
Paul recommends Qwen3.6-27B (dense) for coding. Jun Song says dense 27B on Mac is "painfully slow." This isn't a contradiction — it's a **context distinction**:
| Factor | Paul's Context | Jun Song's Context |
|--------|---------------|-------------------|
| **Hardware** | Any laptop (x86, ARM, Mac) | Specifically Apple Silicon / MLX |
**Resolution:** The performance of dense 27B depends heavily on **framework + quantization**:
- **Unsloth quantized on llama.cpp** (Paul's path): tractable on commodity laptops
- **Unquantized/dq on MLX** (Jun Song's path): slow because MLX doesn't optimize for dense
- **MoE variant (35B-A3B)**: optimal on both paths — sparse activation reduces compute per token
**Recommendation:** If you're on a Mac, follow Jun Song's advice (MoE models via MLX). If you're on any laptop with llama.cpp + Unsloth quants, Paul's dense 27B recommendation works. When in doubt, pick the MoE variant (Qwen3.6-35B-A3B) — it's the convergence point.
---
## Complement to MLX MoE Optimization
This page is the **cross-platform companion** to [[mlx-moe-local-ai-optimization.md]]:
**Together:** Jun Song tells you *why* MoE on Mac is better. Paul tells you *what* to run on any laptop and *how*. The MoE variant Qwen3.6-35B-A3B is the overlap — both recommend it, for different reasons.
---
## Model Landscape Summary
| Use Case | Model | Size | Architecture | Hardware Floor |
