How Fast Should We Build Superintelligence? | Nick Bostrom

19 November - 39 mins
Podcast Series The a16z Show

The question isn’t simply whether humanity should race toward superintelligence or stop. Nick Bostrom argues the harder challenge is preserving the ability to slow down when safety falls behind, without turning a temporary pause into permanent technological stagnation.

a16z’s Eddy Lazzarin and Elena Burger sit down with Bostrom to revisit the ideas he helped bring into the mainstream, now that increasingly capable AI systems actually exist. They discuss why alignment may become harder as models grow more situationally aware, which capability improvements may carry more risk than others, and why Bostrom favors “pacing the frontier” rather than committing to a broad or indefinite pause.

They...

39 mins

Series Episodes

Why the Agent Era Needs a New Operating System | DHH Playing

Why the Agent Era Needs a New Operating System | DHH

David Heinemeier Hansson thinks the agent era is reopening a window in computing that has been closed for decades: the chance to build a new operating system people actually want to use. DHH joins a16z General Partners Martin Casado and Anish Acharya to explain why he’s building Omarchy, an agent-first Linux distribution designed around a computer that users can modify simply by asking. They discuss why the command lines, config files, and detailed error messages that once made Linux intimidating now make it unusually well suited to agents, and why DHH believes software development has become cheap enough to challenge decades-old platform lock-in. But if code is becoming abundant, what still matters? DHH argues that taste, craft, and the willingness to obsess over the final 2% become more important, not less. The conversation moves from tiny teams wielding the productive capacity of thousands of people to open models, competition at the frontier, and the return of hacker, demo, and pseudonymous internet culture.

53 mins

20 November Finished

The Missing Layer for Personal AI | First Person Labs’ Ken Liu Playing

The Missing Layer for Personal AI | First Person Labs’ Ken Liu

AI agents are getting smarter, but every new agent still has to learn who you are. What if your preferences, priorities, relationships, and digital context could move with you instead? First Person Labs co-founder Ken Liu joins a16z’s Martin Casado and Joel de la Garza to introduce Second, a personal context layer designed to understand what you’re doing across your digital life and make that context available to the agents you choose. They discuss how Second can proactively connect information across conversations and applications, why protecting such personal data requires a different security architecture, and the longer-term vision of AI that doesn’t just respond to prompts, but understands enough context to know when and how to help.

33 mins

18 November Finished

Can AI Learn to Improve Itself? | Recursive Self-Improvement Playing

Can AI Learn to Improve Itself? | Recursive Self-Improvement

For decades, the idea of AI improving itself was just a thought experiment. Today, AI is already helping researchers at frontier labs run experiments, write code and test ideas faster. Mark Chen says OpenAI has built “AI research interns.” So how far are we from AI that can do the research on its own? In our first episode of Working Theory, a16z general partner Sarah Wang explores recursive self-improvement with two leading AI researchers: Mark Chen, Chief Research Officer at OpenAI, and John Schulman, co-founder and Chief Scientist of Thinking Machines Lab, and co-founder of OpenAI. They cover what RSI actually means, why research taste is so hard to teach, and why AI may be one of our best tools for solving alignment.

17 mins

17 November Finished

Alex Imas & Tyler Cowen | AI Is Moving Fast. Why Isn’t the Economy? Playing

Alex Imas & Tyler Cowen | AI Is Moving Fast. Why Isn’t the Economy?

AI capabilities are improving fast. But will the economy move just as quickly? a16z General Partner Erik Torenberg sits down with Google DeepMind economist Alex Imas and economist Tyler Cowen to examine how advances in AI translate into growth, jobs, wages, and productivity. They debate what it would take to reach double-digit economic growth, why bottlenecks and falling AI costs could slow the impact, and whether frontier lab valuations require much larger productivity gains. They also explore the “economics of intelligence,” including why the bigger shift may come not from smarter individual agents, but from AI agents learning to coordinate at scale.

1 hour 4 mins

16 November Finished

What Breaks When You Scale 10x? | Zipline’s Keller Cliffton Playing

What Breaks When You Scale 10x? | Zipline’s Keller Cliffton

It was illegal to fly autonomously in U.S. airspace when Keller Cliffton started Zipline, so the company went somewhere that would let it prove the technology worked: Rwanda. A decade later, Zipline has made more than 3 million deliveries and is bringing its autonomous delivery network to the U.S. Keller joins Sophia Dew on The Method to explain why Zipline started by delivering blood to hospitals, how operating in the real world shaped the company, and why almost everything has to be reinvented every time the business grows 10x. They also discuss Zipline’s expansion into U.S. home delivery, how the company organizes teams more like special forces than a traditional hierarchy, and why Keller believes demand could eventually reach 50 billion instant deliveries a year in the U.S.

16 mins

15 November Finished

Recommended

No Account

Subscriptions to podcast series are only available to users with an account. Sign in or register to subscribe and access your subscriptions.

Register Sign in

Woops!

Error text.