The Future of Life Institute’s open letter calls for a six-month pause on the training of AI systems more powerful than GPT-4.

The letter warns that AI systems with ‘human-competitive intelligence’ pose ‘profound risks to society and humanity,’ citing research on potential outcomes ranging from propaganda and job loss to loss of control of our civilization. It argues that the current race among AI labs is ‘out of control’ and that decisions about powerful AI ‘must not be delegated to unelected tech leaders.’

Signatories call for a ‘public and verifiable’ pause lasting at least six months, during which shared safety protocols, auditing mechanisms, and new regulatory bodies should be developed. The letter also urges governments to step in with a moratorium ‘if such a pause cannot be enacted quickly.’