Tensions

← home

67 places where your sources disagree. Taking a side is how reading turns into writing. Pick one and argue it.

Once inference dominates lifetime cost (and RL is folded in), Chinchilla badly under-trains: frontier labs now appear to be pretraining ~100x past Chinchilla optimal because every saved inference FLOP pays off across hundreds of trillions of served tokens. Chinchilla is a starting point, not a target.

πŸŽ™Gavin Baker on All-In E274 - 2026πŸŽ™Reiner Pope on Dwarkesh Patel - 2026

You can store it in HBM (fast, expensive), in DDR/flash (slow, cheap), or recompute it from scratch (cache miss cost β‰ˆ a full prefill pass). The choice depends on how long you intend to keep it. Long context is bottlenecked here, not in compute, which is also why million-token windows have not arrived without sparse attention.

πŸ“–The next big breakthrough will be AIs learning on the job - Dwarkesh PatelπŸŽ™Reiner Pope on Dwarkesh Patel - 2026

Foody argues RL environments could subsume the entire economy because the addressable market equals what humans can do that models cannot, and each new layer of tool or trajectory complexity reopens that gap. Skeptics counter with near-term plateau fears and the question of how long humans stay in the loop before superintelligence closes it.

πŸ“–The next big breakthrough will be AIs learning on the job - Dwarkesh PatelπŸŽ™Brendan Foody on 20VC - 2025

Holiday's amor fati asks you to love fate outright, while Robbins's Let Them keeps a second step where you still choose what to do next; de Mello goes further and dissolves the one doing the accepting.

πŸ“–The Let Them Theory - Robbins-RobbinsπŸ“–The Obstacle Is the Way - Holiday

The 2026 consensus (Luo Fuli) is that agent capability is now bound by post-training, not pre-training: the base model gap has largely closed, so the differentiation moves to how well a team does RL on agents and how fast it can rewrite agent-centric infra. Yet Yao Shunyu notes that outside agentic coding, no agent scenario has yet formed a real data flywheel, so the durable advantage still sits on the model side.

πŸŽ™Luo Fuli on Zhang Xiaojun - 2026πŸŽ™Yao Shunyu on Zhang Xiaojun - 2026

Three causes co-exist and are hard to separate cleanly: (1) genuine grievance about asymmetric returns to AI capital owners, (2) state-actor influence operations of the kind that have run against rival nations since the Cold War, and (3) a Copernican-style displacement of the human from the center of the value-creation story. Builders who only argue with the third cause lose the first two by default.

De Mello and Holiday prize non-attachment to outcomes and people, while Christensen and Strauss argue committed devotion to a relationship is worth the dependence it creates.

πŸ“–Awareness - Mello_et_al

Without batching, cost-per-token is roughly 1000x worse. But the batch is also a queue: it forces a fixed cadence (~20ms on modern HBM), so a large batch buys cheaper tokens at the price of tail latency for any individual request.

πŸŽ™Gavin Baker on All-In E274 - 2026πŸŽ™Reiner Pope on Dwarkesh Patel - 2026

Schwartz treats belief in your own success as the prime mover. Aurelius would caution that belief aimed at external achievement is vanity, and that the only worthy conviction is in your own virtue and judgment.

πŸ“–The Defining Decade - JayπŸ“–The Hard Thing About Hard Things - HorowitzπŸ“–The Magic of Thinking Big - SchwartzπŸ“–The Obstacle Is the Way - HolidayπŸŽ™The Divine Leaf (Coca) - Tim Ferriss - 2026

Ferrari shows that mass awareness and ultra-exclusivity can reinforce each other: 400 million F1 fans make the scarcity meaningful rather than obscure. But brand licensing nearly destroyed the same asset by extracting short-term margin from long-term meaning. The question: can a brand survive being both widely known and narrowly owned, or does every extension eventually collapse the gap that created the value?

Rumelt says the leader must simplify (diagnosis as radical reduction). Allen says you must think through every dimension (GTD clarify questions as completeness). The resolution may be contextual: leaders simplify for teams, but individuals need completeness in their own systems. McKeown's 90% rule provides sharp decisional clarity but risks discarding genuinely valuable opportunities that don't fit a single criterion.

πŸ“–Essentialism - MckeownπŸ“–Good Strategy Bad Strategy - RumeltπŸ“–Meditations - Aurelius_et_alπŸ“–bookπŸ“–Nonviolent Communication A Language of Life - Rosenberg-ChopraπŸ“–The 4-Hour Workweek, Expanded and Updated - FerrissπŸ“–The Almanack of Naval Ravikant - Jorgenson_et_alπŸ“–The Defining Decade - JayπŸ“–The Hard Thing About Hard Things - HorowitzπŸ“–The Magic of Thinking Big - SchwartzπŸŽ™Ferrari - 2026πŸŽ™ζ²‰ι»˜ηš„δΈ»θ§’ - ιŸ¦ι’ - 2025

Frontier context has been stuck near 100-200K for two years because that is where the cost-equal point sits for dense attention. The "we just need bigger context for AGI" claim runs straight into this bandwidth wall; without sparse attention, getting to hundred-million-token contexts is not affordable.

πŸ“–The next big breakthrough will be AIs learning on the job - Dwarkesh PatelπŸŽ™Reiner Pope on Dwarkesh Patel - 2026

Continual learning collides with current safety, eval, and deployment assumptions: a model whose weights drift in production cannot be re-certified against a fixed benchmark. The unlock is also the failure mode β€” sustained drift without guardrails is how alignment problems become operational problems.

πŸ“–The next big breakthrough will be AIs learning on the job - Dwarkesh PatelπŸŽ™Gavin Baker on All-In E274 - 2026πŸŽ™Luo Fuli on Zhang Xiaojun - 2026

It is a rule of thumb, not a theorem, and "equal" can mean 50/50 or 33/33/33 depending on how many cost terms you split into. The looseness is fine because the underlying inputs (traffic forecasts, model lifetimes) carry order-of-magnitude error bars themselves.

πŸŽ™Reiner Pope on Dwarkesh Patel - 2026

Outsiders tend to read a constitutive practice as a consumer habit, so banning or "substituting" it looks costless when it actually severs membership and belonging. The same act can be hygiene policy from one side and erasure from the other.

πŸŽ™The Divine Leaf (Coca) - Tim Ferriss - 2026

Essentialism demands radical selectivity (the 90% rule), but we systematically grab the first solution and justify it (Rumelt) and motivated reasoning distorts confidence (Housel). You must decide boldly while knowing your decision-making machinery is biased. Taleb insists decisions require skin in the game, yet past investment -- the ultimate skin -- triggers sunk-cost traps.

πŸ“–bookπŸ“–How Will You Measure Your Life - Christensen_et_alπŸ“–The 4-Hour Workweek, Expanded and Updated - FerrissπŸ“–The Almanack of Naval Ravikant - Jorgenson_et_alπŸ“–The Defining Decade - JayπŸ“–The Hard Thing About Hard Things - HorowitzπŸ“–The Magic of Thinking Big - SchwartzπŸ“–The Truth - StraussπŸŽ™Ferrari - 2026πŸŽ™ζ²‰ι»˜ηš„δΈ»θ§’ - ιŸ¦ι’ - 2025

Disaggregation extends the useful life of older GPUs (10-15 years as decode-front nodes drop the workload they're bad at), which collides with the bear thesis that GPU lifespans are ~2 years. The amortization implication β€” cheaper financing on the most depreciation-resistant component β€” is itself a competitive moat that pure-play ASIC clouds don't get.

Rosenberg treats empathy as a genuine connection and an end in itself. Voss teaches tactical empathy as an instrument for winning negotiations, raising the question of whether instrumental empathy is still authentic when the behavior is identical.

πŸ“–Effortless - MckeownπŸ“–How Will You Measure Your Life - Christensen_et_alπŸ“–Nonviolent Communication A Language of Life - Rosenberg-ChopraπŸ“–The Truth - Strauss

Yao Shunyu warns that every evaluation framework is easy to hack, because you can always make a metric look good without the underlying result being real (Goodhart). His proposed defense is not a better metric but dependable people who instinctively ask whether a good-looking number is actually good. This pushes the hard, differentiating work upstream into problem definition.

πŸ“–Nonviolent Communication A Language of Life - Rosenberg-ChopraπŸ“–The 4-Hour Body - FerrissπŸ“–The Hard Thing About Hard Things - HorowitzπŸŽ™Brendan Foody on 20VC - 2025πŸŽ™Yao Shunyu on Zhang Xiaojun - 2026

McKeown says focus harder on fewer things. Burkeman warns that the entire framework of "doing the right things efficiently" is itself the trap -- if focus is driven by the illusion of control over time, it is still playing the wrong game. Rumelt and McKeown align (corner solutions mirror the 90% rule), but organizational focus and personal focus may operate by different principles at scale.

πŸ“–Effortless - MckeownπŸ“–Ego Is the Enemy - HolidayπŸ“–Essentialism - MckeownπŸ“–Good Strategy Bad Strategy - RumeltπŸ“–Meditations - Aurelius_et_alπŸ“–The 4-Hour Body - FerrissπŸ“–The 4-Hour Workweek, Expanded and Updated - FerrissπŸ“–The Almanack of Naval Ravikant - Jorgenson_et_alπŸ“–The Hard Thing About Hard Things - HorowitzπŸ“–The Magic of Thinking Big - SchwartzπŸ“–The Obstacle Is the Way - HolidayπŸŽ™Ferrari - 2026πŸŽ™The Divine Leaf (Coca) - Tim Ferriss - 2026πŸŽ™ζ²‰ι»˜ηš„δΈ»θ§’ - ιŸ¦ι’ - 2025

Grief as something to "get through" vs. something you carry forward. The five stages suggest progression, but lived experience shows overlap, regression, and coexistence of multiple stages. Numbness can be both a prison and a protection mechanism.

πŸ“–Meditations - Aurelius_et_al

Growth as discomfort vs. growth as flow. Grit narratives emphasize grinding through pain, while other perspectives suggest growth happens when challenge meets capability. Not all discomfort signals growth, and not all comfort signals stagnation.

πŸ“–Effortless - MckeownπŸ“–Ego Is the Enemy - HolidayπŸ“–How Will You Measure Your Life - Christensen_et_alπŸ“–Meditations - Aurelius_et_alπŸ“–The 4-Hour Workweek, Expanded and Updated - FerrissπŸ“–The Almanack of Naval Ravikant - Jorgenson_et_alπŸ“–The Defining Decade - JayπŸ“–The Magic of Thinking Big - SchwartzπŸ“–The Obstacle Is the Way - HolidayπŸ“–The Truth - Strauss

Clear says habits should flow from identity ("I am a runner"), yet warns that rigid identity makes you brittle. The two-minute rule (start trivially small) and the Goldilocks rule (challenge at the edge of ability) apply to different phases: establishment vs. maintenance. No amount of clever cue-craving-response-reward design eliminates the need for raw discipline when boredom arrives.

πŸ“–Atomic Habits - ClearπŸ“–Effortless - MckeownπŸ“–Ego Is the Enemy - HolidayπŸ“–Essentialism - MckeownπŸ“–How Will You Measure Your Life - Christensen_et_alπŸ“–The 4-Hour Body - FerrissπŸ“–The Almanack of Naval Ravikant - Jorgenson_et_alπŸŽ™The Divine Leaf (Coca) - Tim Ferriss - 2026πŸŽ™ζ²‰ι»˜ηš„δΈ»θ§’ - ιŸ¦ι’ - 2025

Hedonic treadmill suggests happiness returns to baseline regardless of events, yet relationships, hard challenges, and anticipation demonstrably move the baseline upward. The paradox: the best time to work on happiness is when you feel no urgency to.

πŸ“–Awareness - Mello_et_alπŸ“–The 4-Hour Workweek, Expanded and Updated - FerrissπŸ“–The Almanack of Naval Ravikant - Jorgenson_et_alπŸ“–The Let Them Theory - Robbins-RobbinsπŸ“–The Obstacle Is the Way - HolidayπŸ“–The Truth - StraussπŸŽ™The Divine Leaf (Coca) - Tim Ferriss - 2026

Compute (FLOPs) is the headline number in marketing, but memory bandwidth and scale-up domain size are usually what actually moves the frontier. Rack design lives at the intersection of mundane physics β€” cable density, weight, cooling β€” and frontier model possibility.

πŸŽ™Gavin Baker on All-In E274 - 2026πŸŽ™Luo Fuli on Zhang Xiaojun - 2026

Clear says deliberately construct an identity to drive habits ("I am a writer"). Housel warns that the identity you build today can trap your future self via sunk costs. Taleb adds that identity must be earned through risk, not just declared -- an identity adopted without skin in the game is performative. The question is how flexible an identity can be before it stops providing motivational force.

πŸ“–Atomic Habits - ClearπŸ“–Awareness - Mello_et_alπŸ“–Effortless - MckeownπŸ“–Ego Is the Enemy - HolidayπŸ“–How Will You Measure Your Life - Christensen_et_alπŸ“–Meditations - Aurelius_et_alπŸ“–Nonviolent Communication A Language of Life - Rosenberg-ChopraπŸ“–The Almanack of Naval Ravikant - Jorgenson_et_alπŸ“–The Defining Decade - JayπŸ“–The Hard Thing About Hard Things - HorowitzπŸ“–The Let Them Theory - Robbins-RobbinsπŸ“–The Magic of Thinking Big - SchwartzπŸ“–The Obstacle Is the Way - HolidayπŸ“–The Psychology of Money - HouselπŸ“–The Truth - StraussπŸŽ™Ferrari - 2026πŸŽ™Luo Fuli on Zhang Xiaojun - 2026πŸŽ™The Divine Leaf (Coca) - Tim Ferriss - 2026πŸŽ™Yao Shunyu on Zhang Xiaojun - 2026πŸŽ™ζ²‰ι»˜ηš„δΈ»θ§’ - ιŸ¦ι’ - 2025

Lower latency and lower cost-per-token pull in opposite directions: small batches give fast tokens at high amortized cost, large batches give cheap tokens at higher tail latency. Pricing tiers (Fast Mode, Slow Mode) are just different points on this same curve, not different physics.

πŸ“–The next big breakthrough will be AIs learning on the job - Dwarkesh PatelπŸŽ™Gavin Baker on All-In E274 - 2026πŸŽ™Luo Fuli on Zhang Xiaojun - 2026πŸŽ™Reiner Pope on Dwarkesh Patel - 2026

Robbins insists pressure always produces resistance because people need to feel in control of their decisions, while Horowitz's management context assumes a leader still sets nonnegotiable decisions and delivers them directly.

πŸ“–The Let Them Theory - Robbins-Robbins

Latency floors and cost floors live on opposite ends of the batch-size curve. Pipelining adds a few milliseconds per rack hop and stacks across pipeline stages, so pushing scale-up larger (rather than scale-out) is the only path to lower latency at frontier model sizes.

πŸŽ™Reiner Pope on Dwarkesh Patel - 2026

Rumelt says the leader acts on the organization (absorbs complexity, passes down simpler problems). Kleiner says the organization acts on the leader (leadership is getting others to confer legitimacy). Both are true but describe different phases: you earn legitimacy first, then use it to simplify and direct. Rumelt's warning that universal buy-in signals absence of real choice creates tension with collaborative leadership models.

πŸ“–Ego Is the Enemy - HolidayπŸ“–Essentialism - MckeownπŸ“–Good Strategy Bad Strategy - RumeltπŸ“–How Will You Measure Your Life - Christensen_et_alπŸ“–The Hard Thing About Hard Things - HorowitzπŸ“–The Magic of Thinking Big - SchwartzπŸ“–bookπŸŽ™Ferrari - 2026πŸŽ™Brendan Foody on 20VC - 2025πŸŽ™Luo Fuli on Zhang Xiaojun - 2026πŸŽ™ζ²‰ι»˜ηš„δΈ»θ§’ - ιŸ¦ι’ - 2025

Bandwidth scales with the number of chips in a scale-up domain, not with chip count alone, so adding racks via scale-out helps capacity but not latency. Pipelining hides weight bandwidth across racks but cannot do the same for KV cache bandwidth, which is why long context remains expensive.

πŸŽ™Reiner Pope on Dwarkesh Patel - 2026

Going sparser lowers compute but inflates total parameters super-linearly for quality gains (e.g. 64x params for 4x effective dense size), and pushes more onto memory bandwidth and scale-up bandwidth. The sweet spot is "as sparse as your scale-up domain can hold the weights and your traffic can fill the batch."

πŸŽ™Reiner Pope on Dwarkesh Patel - 2026

Yao Shunyu observes that no scenario has yet formed a real data flywheel, and apart from agentic coding no purely AI-native application has become highly successful, so a thin wrapper (ε£³) survives only by outrunning the labs to user mindshare or by staying in a market too small for them to bother with. This sits in tension with the application-layer optimism common among founders.

πŸ“–The Hard Thing About Hard Things - HorowitzπŸŽ™Brendan Foody on 20VC - 2025πŸŽ™Yao Shunyu on Zhang Xiaojun - 2026

Benchmark scores rank base models; product quality is largely set by the harness. A frontier model with a weak harness ships as a chatbot; a mid-tier model with a strong harness ships as a useful agent. This makes "frontier" an ambiguous category β€” frontier *model* and frontier *system* are different things, and they need to be co-developed.

πŸŽ™Gavin Baker on All-In E274 - 2026πŸŽ™Luo Fuli on Zhang Xiaojun - 2026

Christensen separates hygiene factors that only remove dissatisfaction from true motivators, while Holiday's purpose-over-passion and de Mello's dropping of desire disagree about whether motivation should be cultivated or transcended.

πŸ“–Atomic Habits - ClearπŸ“–How Will You Measure Your Life - Christensen_et_alπŸ“–The 4-Hour Body - FerrissπŸ“–The Let Them Theory - Robbins-Robbins

Voss teaches empathy as a tactic, raising the question of whether instrumental empathy is genuine -- though the behavior is identical either way. "No" as gold and "That's right" as the goal seem contradictory but operate at different stages: "no" clears the ground, "that's right" is the destination. Giving the "illusion of control" sounds manipulative, but calibrated questions genuinely invite collaborative problem-solving.

πŸ“–bookπŸ“–Nonviolent Communication A Language of Life - Rosenberg-ChopraπŸ“–The Hard Thing About Hard Things - Horowitz

The empirical winners (expert within a rack, pipeline across racks) match the model's natural seams, while the historically beloved tensor parallelism has faded as experts have shrunk. The choice is constrained by which communication pattern fits which network: all-to-all wants full intra-rack connectivity, pipelining tolerates slow scale-out.

πŸŽ™Reiner Pope on Dwarkesh Patel - 2026

Pipelining solves weight-capacity problems cleanly but does nothing for KV cache (per-GPU activation footprint is invariant) and adds milliseconds of latency per hop. In inference it is often skipped β€” modern racks already hold a trillion-parameter model β€” but it lets hardware designers cut HBM-per-GPU if they assume the model spans multiple racks.

πŸŽ™Reiner Pope on Dwarkesh Patel - 2026

As compute shifts toward post-training (Luo Fuli reports top teams moving from a roughly 3:5:1 to a 3:1:1 research/pre-train/post-train split, with pre-train to post-train heading to 1:1), the lead increasingly comes from RL and agent infra rather than raw pre-training scale. This also reshapes org design: post-training now rewards background diversity, and moving pre-training people into post-training is a strong complement.

πŸ“–The next big breakthrough will be AIs learning on the job - Dwarkesh PatelπŸŽ™Luo Fuli on Zhang Xiaojun - 2026

If outcomes are power-law, the moat is not volume but the ability to source and match the rare 10x contributors, which argues against commoditized crowdsourcing. The open question is whether the matching infrastructure is itself defensible or eventually replicated.

Two 2026 views collide. Yao Shunyu argues pre-training has not plateaued and that most people who think a scaling law is exhausted actually have an undiscovered bug. Luo Fuli argues the pre-training gap across frontier labs has essentially closed, so last era's pre-training success no longer guarantees this era's lead, and a roughly 1T base model is now just the entry ticket.

πŸŽ™Luo Fuli on Zhang Xiaojun - 2026πŸŽ™Yao Shunyu on Zhang Xiaojun - 2026

Yao Shunyu argues that on paper everyone's models look similar, so the real differentiation comes from how clearly you define the problem and the behavior you want, and much of the observed gap between models traces back to this unglamorous definition work rather than to cleverness. It is the upstream counterpart to evaluation: a poorly defined problem cannot be evaluated honestly.

πŸ“–Effortless - MckeownπŸ“–How Will You Measure Your Life - Christensen_et_alπŸŽ™Brendan Foody on 20VC - 2025πŸŽ™The Divine Leaf (Coca) - Tim Ferriss - 2026πŸŽ™Yao Shunyu on Zhang Xiaojun - 2026

Horowitz says figuring out the right product is the innovator's job, not the customer's, which sits uneasily with validation-first schools that treat customer feedback as the primary compass.

πŸ“–The Hard Thing About Hard Things - Horowitz

GTD and Atomic Habits provide systems for reliable execution; Burkeman argues that reliable execution of the wrong frame just accelerates the treadmill. McKeown sits between: his "one-time decisions" share GTD's systematic spirit, but his philosophy aligns with Burkeman -- do dramatically less, better. Clear says goals are overrated (systems-over-goals), while Allen's methodology organizes around defining desired outcomes for every commitment.

πŸ“–Atomic Habits - ClearπŸ“–Essentialism - MckeownπŸ“–bookπŸ“–The 4-Hour Workweek, Expanded and Updated - FerrissπŸ“–The Magic of Thinking Big - SchwartzπŸŽ™Luo Fuli on Zhang Xiaojun - 2026πŸŽ™The Divine Leaf (Coca) - Tim Ferriss - 2026

The most effective manufacture of ignorance is not a faked study but an unrun one. Choosing not to investigate a question whose answer you fear can be more durable than producing bad data, because the absence of evidence reads as a neutral gap rather than a deliberate act.

πŸ“–The 4-Hour Body - FerrissπŸŽ™The Divine Leaf (Coca) - Tim Ferriss - 2026

Ego Is the Enemy elevates purpose above passion as the mature engine of work, while de Mello's Awareness would dissolve even purpose-driven striving into present-moment awareness.

πŸ“–Ego Is the Enemy - HolidayπŸ“–Essentialism - MckeownπŸ“–The Defining Decade - Jay

Most discussion of "reusability" conflates two regimes: refurb-and-refly (30-60 days, achievable by several entrants over the next decade) versus rapid reusability (turn-the-rocket-around-in-hours, required for Moon/Mars logistics and orbital compute). Treating them as the same metric understates SpaceX's lead.

Academic benchmarks such as Olympiad math are easy to state but wholly disconnected from enterprise value, while realistic rubric-graded task evals are expensive to build. Foody frames the eval as the product's PRD, which makes eval design, not model access, the scarce skill.

πŸ“–The next big breakthrough will be AIs learning on the job - Dwarkesh PatelπŸŽ™Brendan Foody on 20VC - 2025

If RSI lands, the implicit scaling law shifts from "more compute + more tokens" to "more compute + better feedback loops" β€” which favors labs with the largest coherent compute clusters and proprietary RL infrastructure, not whoever has the largest crawl. Whether RSI is the actual unlock or just a fundraising narrative is unsettled; Anthropic's pre-training hire of Karpathy is the most expensive bet on the bull case to date.

πŸ“–The next big breakthrough will be AIs learning on the job - Dwarkesh PatelπŸŽ™Gavin Baker on All-In E274 - 2026πŸŽ™Luo Fuli on Zhang Xiaojun - 2026

Luo Fuli frames "how to do RL scaling on agents" as the competitive crux of 2026. The infra implication is a shift from a rollout-inference-engine-centric system (long chains of thought ending in an answer) to an agent-centric system where the model-agent coupling is the hard problem, demanding new and more agile RL infra. Yao Shunyu adds the provocation that pre-training is also a kind of RL, blurring the line between the two stages.

πŸ“–The next big breakthrough will be AIs learning on the job - Dwarkesh PatelπŸŽ™Brendan Foody on 20VC - 2025πŸŽ™Luo Fuli on Zhang Xiaojun - 2026

Relationships as the greatest source of both happiness and pain. Anger from grief targets those we feel safest around. Trust enables directness but requires evidence. The workplace relationship question: can professional relationships carry the same weight as personal ones?

πŸ“–Awareness - Mello_et_alπŸ“–How Will You Measure Your Life - Christensen_et_alπŸ“–Meditations - Aurelius_et_alπŸ“–The Almanack of Naval Ravikant - Jorgenson_et_alπŸ“–The Defining Decade - JayπŸ“–The Hard Thing About Hard Things - HorowitzπŸ“–The Let Them Theory - Robbins-RobbinsπŸ“–The Magic of Thinking Big - SchwartzπŸ“–The Truth - Strauss

A known-open problem in RL. Most economically valuable skills (running a business, litigation, politics, trading) are reset-free, so the farmable-simulator trick that works for coding β€” and eventually computer use β€” doesn't apply. That forces reliance on sample efficiency rather than parallel grinding.

πŸ“–The next big breakthrough will be AIs learning on the job - Dwarkesh Patel

The model is intentionally crude: a real cluster has all-to-all communication overhead, MFU losses, and prefill/decode interleaving that the simple max ignores. The right reaction is to add 2-3x safety margin, not to add detail β€” most insight lives in where the two curves cross.

πŸŽ™Reiner Pope on Dwarkesh Patel - 2026

Dwarkesh argues sample efficiency and continual learning are the same problem: on-the-job data is scarce, so learning from it at all requires being sample-efficient. In-context learning achieves it but is memory-bound; gradient updates are durable but sample-inefficient. The labs bet that brute-force RL scale steamrolls the deficit; Dwarkesh bets it can't for reset-free domains where no farmable simulator exists.

πŸ“–The next big breakthrough will be AIs learning on the job - Dwarkesh Patel

Bigger is better for both bandwidth and the size of expert-parallel layer you can fit, but physical constraints (cable density, power, weight, cooling) cap how many chips fit in one rack. The real engineering battle isn't FLOPs per chip, it's wire density per rack.

πŸŽ™Gavin Baker on All-In E274 - 2026πŸŽ™Reiner Pope on Dwarkesh Patel - 2026

Pure training-compute scaling (Chinchilla) is now a special case of a broader cost-equalization problem that includes RL and inference, and the optimum shifts dramatically depending on which terms you include. Public scaling laws also lag what frontier labs actually use, so any number derived from them is a lower bound on real-world precision.

πŸ“–The next big breakthrough will be AIs learning on the job - Dwarkesh PatelπŸŽ™Brendan Foody on 20VC - 2025πŸŽ™Jensen Huang - 2026πŸŽ™Gavin Baker on All-In E274 - 2026πŸŽ™Luo Fuli on Zhang Xiaojun - 2026πŸŽ™Reiner Pope on Dwarkesh Patel - 2026πŸŽ™Yao Shunyu on Zhang Xiaojun - 2026

Rumelt frames scarcity as strategy's precondition: you must choose because resources are finite. Ferrari inverts this: they create scarcity artificially, making constraint the product itself. This raises a question: is manufactured scarcity a genuine strategy or just a pricing mechanism? The licensing trap (100% margin that cheapens the brand) suggests scarcity only works when it is consistently applied across every touchpoint, not just production.

πŸ“–Effortless - MckeownπŸ“–The Almanack of Naval Ravikant - Jorgenson_et_alπŸ“–The Hard Thing About Hard Things - HorowitzπŸŽ™Ferrari - 2026

OPSD needs no verifiable outer reward and gives denser supervision than RL, while inheriting RL's sparse-update property that guards against catastrophic forgetting. The open question is whether matching a teacher's per-token distribution captures durable skill or merely imitates surface trajectories β€” and how to handle the rollout after the student diverges from the teacher's path.

πŸ“–The next big breakthrough will be AIs learning on the job - Dwarkesh Patel

Quality vs. cost is still empirical territory, but the math is decisive: dense attention caps practical context at the current 100-200K plateau, while sparse attention is the only known route to million-plus token windows without exploding serving cost.

πŸ“–The next big breakthrough will be AIs learning on the job - Dwarkesh PatelπŸŽ™Reiner Pope on Dwarkesh Patel - 2026

Strategy is a hypothesis to test and refine (Rumelt), yet corner solutions require all-in concentration that precludes hedging. Rumelt argues for extreme focus on a narrow front, while Jensen's five-layer AI stack suggests you need strength across the full system -- the resolution may be that "narrow" means a few tightly co-designed things, not literally one.

πŸ“–Effortless - MckeownπŸ“–Good Strategy Bad Strategy - RumeltπŸ“–How Will You Measure Your Life - Christensen_et_alπŸ“–The 4-Hour Workweek, Expanded and Updated - FerrissπŸ“–The Hard Thing About Hard Things - HorowitzπŸ“–The Magic of Thinking Big - SchwartzπŸŽ™Ferrari - 2026πŸŽ™Brendan Foody on 20VC - 2025πŸŽ™Gavin Baker on All-In E274 - 2026πŸŽ™Luo Fuli on Zhang Xiaojun - 2026πŸŽ™Yao Shunyu on Zhang Xiaojun - 2026πŸŽ™ζ²‰ι»˜ηš„δΈ»θ§’ - ιŸ¦ι’ - 2025

Pure systems thinking can degenerate into hand-waving; the useful version always lands on a number (a roofline, a ratio, a crossover point). The biggest performance leaps come from rethinking the boundaries between layers rather than pushing harder within one layer.

πŸŽ™Brendan Foody on 20VC - 2025πŸŽ™Jensen Huang - 2026πŸŽ™Gavin Baker on All-In E274 - 2026πŸŽ™Luo Fuli on Zhang Xiaojun - 2026πŸŽ™Reiner Pope on Dwarkesh Patel - 2026πŸŽ™The Divine Leaf (Coca) - Tim Ferriss - 2026πŸŽ™Yao Shunyu on Zhang Xiaojun - 2026

Proposed as a fourth scaling axis beyond pretraining, RL, and inference, but rests on the hard prerequisite of simulating the open world β€” far harder than emulating Go or Atari, which is why Dwarkesh flags it as speculative.

πŸ“–The next big breakthrough will be AIs learning on the job - Dwarkesh Patel

Voss builds trust through empathy and making the other side feel heard (emotional trust). Taleb builds trust through demonstrated risk-bearing and action (structural trust). Jensen's fixed pricing shows trust through predictability over decades. These are different faces of the same asset, but they can conflict: the Silver Rule's passive restraint may be necessary but insufficient without proactive vulnerability.

πŸ“–Ego Is the Enemy - HolidayπŸ“–bookπŸ“–The Almanack of Naval Ravikant - Jorgenson_et_alπŸ“–The Hard Thing About Hard Things - HorowitzπŸ“–The Magic of Thinking Big - SchwartzπŸ“–The Truth - StraussπŸŽ™Ferrari - 2026πŸŽ™Jensen Huang - 2026πŸŽ™Gavin Baker on All-In E274 - 2026πŸŽ™Yao Shunyu on Zhang Xiaojun - 2026πŸŽ™ζ²‰ι»˜ηš„δΈ»θ§’ - ιŸ¦ι’ - 2025

Naval frames wealth-building as the game worth playing. Housel counters that the real skill is knowing when enough is enough, and the Stoics would call accumulation itself an external indifferent.

πŸ“–The Almanack of Naval Ravikant - Jorgenson_et_alπŸ“–The Defining Decade - JayπŸ“–The Hard Thing About Hard Things - Horowitz

Isolation gives precision, reproducibility, and patentability, and sometimes a clean compound beats the raw plant (aspirin over willow bark). But isolating the famous component can collapse interest in everything else in the plant and produce a harsher, narrower drug than the mixture the body can modulate.

πŸŽ™The Divine Leaf (Coca) - Tim Ferriss - 2026