金色财经|11月 17, 2026 14:18
[my country's Daily Meta-call Volume Exceeds 500 Trillion] According to Jinse Finance, on November 17th, the latest data shows that China's daily meta-call volume has exceeded 500 trillion, leading to a surge in demand for computing power. Intelligent computing power cannot be replenished in the short term, so the only option is to leverage existing resources. In 2025, Academician Zheng Weimin's team developed the large-scale model inference system Mooncake, which won the Eric Riddell Best Paper Award. Its core technology is using PD separation to revitalize existing computing power and using software scheduling to fully utilize existing computing power. It is understood that P is responsible for "reading in user questions," and D is responsible for "generating answers." In the traditional approach, the same batch of computing power takes turns doing both tasks; PD separation allows one group to only read the questions and send the results to another group dedicated to answering them. With the same hardware scale, the system can handle 75% more user requests, increasing long text throughput by more than five times. (CCTV Finance)
Share To
HotFlash
APP
X
Telegram
CopyLink