Reboot Dialogue #25 | Rogue AI and Catastrophic Risk

Watch on YouTube

Rogue AI and Catastrophic Risk

What if artificial intelligence (AI) continues to progress towards and beyond our abilities, in areas where it could become dangerous, and what if our regulations won’t be 100% foolproof, opening the door to seriously harmful misuse by bad actors, historically never seen concentrations of power and existential threats to our collective future? Even if these were a low-probability events, given the high stakes, should we not have a plan B?

With a view to minimising those risks, Yoshua Bengio proposes the creation of a multilateral network of non-profit and non-governmental labs, collaborating on the defence of democracy, human rights and against eventual rogue autonomous AI. His proposal hinges on avoiding a single point of failure and excessive concentrations of power (economic, political and military), and establishing strong democratically mandated international governance mechanisms.

In this Reboot Dialogue we talk, both about the various ways in which AIs potentially pose an existential threat to democracy and human rights, and what it would take, what kind of governance architecture we would need to put into place, to protect us against AI-driven catastrophic risks.

Yoshua Bengio is professor of computer science at the Université de Montréal, founder and scientific director of Mila–Quebec Artificial Intelligence Institute, and senior fellow and codirector of the Learning in Machines and Brains program at the Canadian Institute for Advanced Research. He won the 2018 A.M. Turing Award (with Geoffrey Hinton and Yann LeCun).

More information about Yoshua Bengio is available on our contributors' page. His paper on AI and catastrophic risk is now out in the Journal of Democracy.