金色财经|11月 19, 2026 05:24
[Epoch AI: Agent Inference Capacity Increases 4.6 Times in One Year, Computing Power Increases 2.6 Times] According to Jinse Finance, on November 19th, Epoch AI released data insights stating that from Q2 2025 to Q2 2026, the estimated agent inference capacity of sold AI chips increased 4.6 times, while peak 8-bit computing power increased 2.6 times during the same period. This calculation uses its Inference Performance Index (IPI), comparing hardware with fixed agent workloads in long cache contexts, taking into account memory, inter-chip communication, and low-precision calculations, and summing the cumulative sales of various chip types by the score per chip. The growth is mainly driven by the transition from Hopper to Blackwell: Blackwell and Blackwell Ultra contributed 74% of the new capacity, with the GB300 system having approximately 8 times the inference capacity per GPU of the H200; by Q2 2026, the two combined will account for approximately 73% of the total inference capacity and 50% of the total peak computing power. The new capacity of chips sold in the second quarter of 2026 was 3.3 times that of the same period in 2025, lower than the overall capacity growth rate. Epoch AI expects the overall growth rate to slow down. Based on quarterly new capacity, inference capacity increased by 3.2 times year-on-year and peak computing power increased by 2.1 times year-on-year. It is expected that hardware and model co-design will continue to make inference capacity grow faster than peak computing power.
Share To
Timeline
HotFlash
APP
X
Telegram
CopyLink