Google CEO Warns the ‘Low-Hanging Fruit’ Era of AI Development Is Over

CN
Decrypt
Follow
4 months ago

The era of AI developers using large datasets of information scraped from the internet and the days of “low-hanging fruit” may be over, Google CEO Sundar Pichai suggested at the New York Times’ annual Dealbook Summit on Wednesday.


“In the current generation of LLM models, roughly a few companies have converged at the top, but I think we're all working on our next versions too,” Pichai said. “I think the progress is going to get harder.”


Pichai’s comments come as researchers report a slowdown in the performance of AI models compared to two years ago when ChatGPT was launched to the public.



Others raising concerns about the diminishing returns of AI models include Ethereum co-founder Vitalik Buterin, a16z’s Marc Andreessen and Ben Horowitz, and former OpenAI co-founder and former Chief Scientist Ilya Sutskever, who pointed out scaling AI models learning from massive amounts of unlabeled data, has hit a plateau.


“When I look at 2025 the low-hanging fruit is gone, the curve, the hill is steeper,” Pichai added. “I think the elite teams will stand out in 2025, so I think it's an exciting year from that perspective.”


Pichai’s remarks reflect a growing sentiment in the AI world that the days of simply building bigger models and throwing more data at them to achieve better results might be coming to an end.


Adding to these concerns is the risk of an “AI ouroboros” effect, where models train on data generated by other AIs rather than human-created content.


Named after the ancient image of a serpent eating its tail, the ouroboros effect in AI happens when one AI uses data generated by another AI, creating a feedback loop. Over time, this can lead to repetitive or distorted outputs as the system begins to rely on AI and not human-created data, effectively hitting a wall.


While some developers worry about AI models reaching a plateau, Pichai remains optimistic, suggesting the field will see significant advancements in the coming year.


“I expect a lot of progress in 2025, so I don't fully subscribe to the wall notion,” Pichai said. “But when you start out quickly scaling up, you can throw more compute, and you can make a lot of progress, but you're definitely going to need deeper breakthroughs as we go to the next stage.”


Edited by Sebastian Sinclair


免责声明:本文章仅代表作者个人观点,不代表本平台的立场和观点。本文章仅供信息分享,不构成对任何人的任何投资建议。用户与作者之间的任何争议,与本平台无关。如网页中刊载的文章或图片涉及侵权,请提供相关的权利证明和身份证明发送邮件到support@aicoin.com,本平台相关工作人员将会进行核查。

Bybit: $50注册体验金,$30000储值体验金
Ad
Share To
APP

X

Telegram

Facebook

Reddit

CopyLink