EXO Labs
EXO Labs|Nov 21, 2026 01:38
We worked with @thinkymachines to make Inkling 2 Mini run fast locally: - 210 tok/sec decode, 3620 tok/sec prefill on 96GB M5 Ultra Mac Studio - 125 tok/sec decode, 1750 tok/sec prefill on 48GB M5 Max MacBook Pro It built a native weather app 1.8x faster than Claude Sonnet 5.5 on an M5 Ultra Mac Studio and 11x cheaper (API pricing). The looping architecture is ideal for local devices like MacBooks, which are memory constrained. Looping layers of the model increases inference-time compute (and intelligence) without increasing the size of the model.
Share To

HotFlash

APP

X

Telegram

Facebook

Reddit

CopyLink

Hot Reads