← Knowledge Base

Idea from Luo Fuli on Zhang Xiaojun - 2026

A 1T Base Model Is the Entry Ticket

A 1T Base Model Is the Entry Ticket

Insight

Luo treats a roughly 1-trillion-parameter base model as the entry ticket to reaching something near Claude Opus 4.6 level. Because the pre-training gap has essentially closed, last era's success no longer guarantees this era's lead and everyone is roughly on the same starting line, which is why the next decision (what to scale beyond 1T, and on which chips) determines who leads in half a year.

Source Context

"1T基座模型,是实现接近Claude Opus 4.6水准模型的重要入场券。" "上一个时代的成功并不意味着下一个时代的领先,现在基本上大家在同一水平线。" "我们不会在1T水平上走太久……到底是去scaling模型的参数量,还是去scaling什么东西?以及要在什么样的芯片上去scaling?" — [01:45:24 1T模型是入场券] Gloss: A 1T base model is the ticket to near-Opus-4.6 level; past success no longer carries over, and the next scaling decision sets who leads.

Related Concepts

scaling laws | pre-training | strategy | hardware

TrainingStrategyscalingbase-modelcompetition