Skip to content

Systems Reality

Hybrid Architectures

10 min+110 XPStep 1/11

Split by what each side is good at

The mature edge architecture isn't 'on-device OR cloud' — it's a routing decision per request:

  • On-device handles — the common case, the private case, the latency-critical case: wake words, autocomplete, photo search over personal data, short summaries
  • Cloud handles — the heavy case, the rare case, the case needing more capability than fits: long documents, hard reasoning, anything needing frontier parameters
  • A router decides — complexity classifier, confidence threshold, or explicit user choice picks the path per request

Apple's architecture is the reference: on-device models by default, Private Cloud Compute for what exceeds them — the boundary is a designed policy, not a failure mode.