Can I run a local LLM on iPhone SE (3rd gen)?

Yes, at the right size. iPhone SE (3rd gen) has about 1.6 GB usable. Try Qwen 3 0.6B in LM Mini (the free plan includes four 1–1.7B starter models; bigger catalog models need LM Mini Pro). Bigger models belong on a PC via Connect.

How much RAM does iPhone SE (3rd gen) really have for AI?

4 GB advertised, ~1.6 GB left for weights + KV cache. That is why 7B Q4 fails on many 8 GB phones.

iPhone / iPad · 2022 · A15

Local AI on the iPhone SE (3rd gen)

Smallest RAM Apple still sells in the wild. Tiny GGUF/MLX only — or tap Connect to a home box.

Advertised RAM: 4 GB
Usable for a model: ~1.6 GB
Compute: Metal / ANE
LM Mini path: GGUF / Metal (MLX with Pro)

Start in LM Mini

Install the app, pick one of these, chat offline. The free plan includes four small starter models (1–1.7B); models marked Pro need LM Mini Pro.

Qwen 3 0.6B Fits · ~400–500 MB · Pro

Tiny and quick — good for short replies when your phone is low on memory.

Get LM Mini and load a model that actually fits — on-device, or via Connect to a PC.

App Store Google Play Mac & more

What actually fits

Q4 weights plus KV cache. “Tight” means close Chrome first.

Model	Params	Q4	Here	Where
Qwen 3 0.6B	0.6B	~400–500 MB	Fits	In LM Mini · Pro
Qwen 3.5 0.8B	0.8B	~500–600 MB	Fits	Studio / Ollama
Gemma 3 1B Instruct	1B	~700–750 MB	Tight	In LM Mini · Free

Too big for this phone

Host these on LM Studio or Ollama, then chat from iPhone SE (3rd gen).

How we score this

iPhone SE (3rd gen) ships with 4 GB. After iPhone / iPad we budget ~1.6 GB for inference. A 7B Q4 is ~4.4 GB on disk and wants ~6.5 GB live — that is why it fails on most 8 GB phones. 12–16 GB Android can try 8B. Apple 8 GB phones should live in 1B–4B.