Architecture & economics
Thursday, October 22 · 1:30 to 5:00 pmLecture 1 · The technical architecture of AI
“Training compute is a good proxy for what a model can do.”
We take the AI stack apart, from chips and cloud to foundation models and applications, and look at how scaling works and where it stops working. We then compare open and closed weights.
Exercisein class · no preparation · 25 min
Using Epoch AI’s public data, find the most capable model trained below the 1026 FLOP line used by California and New York. Then ask what the rule would say about it.
Required
- Neil C. Thompson, Kristjan Greenewald, Keeheon Lee & Gabriel F. Manso (2023), “The Computational Limits of Deep Learning”. Ninth Computing within Limits (LIMITS 2023)
- Sara Hooker (2024), “On the Limitations of Compute Thresholds as a Governance Strategy”. arXiv:2407.05694
Optional
- Sara Hooker (2024), “Big AI, The Compute Frenzy, and Grumpy Models”. Scaling Theory podcast, episode 8 Video · Spotify · Apple Podcasts
- Ashish Vaswani et al. (2017), “Attention Is All You Need”. arXiv:1706.03762
- Toby Ord (2025), “Inference Scaling and AI Governance”. Centre for the Governance of AI
- Thibault Schrepel & Jason Potts (2025), “Measuring the Openness of AI Foundation Models: Competition and Policy Implications”. Information & Communications Technology Law 34(3): 279-304 PDF on Canvas
Lecture 2 · The economics of intelligence
“Scale turns AI into a natural monopoly.”
AI combines the capital intensity of heavy industry with the increasing returns of digital markets. We look at fixed costs, prices, data, talent, and the business models firms build around them.
Exercisein class · no preparation · 25 min
The strategy game. Teams play firms and a regulator with twelve strategies, from network effects to regulatory barriers. Each team decides which to use, which to ban, and which to lobby for.
Required
- Anton Korinek & Jai Vipra (2025), “Concentrating intelligence: scaling and market structure in artificial intelligence”. Economic Policy 40(121): 225-256 PDF on Canvas
- Mert Demirer, Andrey Fradkin & Nadav Tadelis (2026), “The Emerging Market for Intelligence: How Firms Buy and Sell AI”. Journal of Economic Perspectives 40(3): 23-46
Optional
- Pierre Azoulay, Joshua L. Krieger & Abhishek Nagaraj (2025), “Old Moats for New Models: Openness, Control, and Competition in Generative AI”. Entrepreneurship and Innovation Policy and the Economy, vol. 4 (NBER WP 32474) PDF on Canvas
- Thibault Schrepel & Alex Pentland (2025), “Competition between AI foundation models: dynamics and policy recommendations”. Industrial and Corporate Change 34(5): 1085-1103 PDF on Canvas