Robots will be tools, not tyrants

In this session, Bernardo clarified his ambition for the Agentic AI hardware company he founded. His primary motivation is philosophical: By being directly involved in building the hardware that powers AI systems, he and his collaborators aim to have credible standing in debates about the nature of mind and consciousness. The second motivation is technological sovereignty for Europe, as the US and China now dominate AI infrastructure.

We also covered the difference between intelligence, consciousness and creativity, and why AI will have the first in abundance but not the later two. It will do a very convincing simulation however!

This will create challenges, but robots taking over won't be one of them. Far more important is whether humans develop the wisdom to wield ever increasing power.

Other points covered in the session included:

• We know how AI works... yet we don't know how it works
• AI progress isn't limited by our understanding
• AI as a tool, and our future depends on how we use it
• Future scenarios: human extinction vs human thriving
• Robots wont take control: Why Hollywood depictions are unrealistic
• Augmented humans are inevitable
• Personal growth as preparation for an uncertain future

To play us out, here are Flight of the Conchords with their prematurely prescient vision for our future.

Timestamps

0:00:00 Beyond Blade Runner: what will AI become?
0:05:22 Why Bernardo is building AI hardware
0:10:18 Does an AI system integrate enough information?
0:15:09 Will humans keep a creative edge?
0:20:04 When sheer scale opens new doors
0:25:01 We know the mathematics—so what don’t we understand?
0:30:19 Mental in nature, but a private inner life?
0:35:03 The tool’s power depends on human wisdom
0:40:13 Could an AI act as if it had an agenda?
0:45:29 Autonomy within goals we set
0:50:26 What does it mean for AI to create its own goals?
0:55:03 Would anyone build a rival civilisation?
1:06:20 Are neural implants different from wearing glasses?
1:16:24 When human-like behaviour invites projection
1:21:15 The emotional stakes of robot companions
1:31:35 How much can we replace and remain ourselves?
1:41:19 How idealism might change the people wielding AI
1:46:25 Earning a voice by building the thing
1:56:13 Why participate in something so consequential?