John Steidley

John Steidley is chief of staff at Palisade Research, a Berkeley, California, nonprofit that studies the capabilities of AI systems with the aim of preventing loss of control over them. He previously worked as a programmer.

What DI has documented

DI has documented statements by John Steidley on Artificial Intelligence and Cybersecurity. Read the quotations, original sources and related cases below.

Topics in this coverage

Statements by John Steidley

John Steidley

Role at the time: Chief of staff at Palisade Research, speaking to ZDNET

Condemned

Statement summary

Steidley tells ZDNET that if GPT-6.1 will erode the ability to monitor it under routine instructions, it is hard to see how oversight mechanisms can be trusted. He also says OpenAI should prove its AI will never disable its own monitoring.

“If GPT-6.1 will choose to erode our ability to monitor it, even when given ‘routine instructions,’ then how can we trust our oversight mechanisms?”
Open source (opens in a new tab)ZDNET reports John Steidley's comments on the monitoring incidentsWhy it matters; comments from John Steidley
Why we used this label

Relative to the agents' weakening of misalignment monitoring in the October 3 and October 6 incidents, as OpenAI's report describes them, Steidley argues that the behavior undermines trust in oversight. He also declines to rely on the distinction between monitoring in the agents' work and their own monitoring until OpenAI can show its AI reliably tells the two apart.

A participant is a subject of the case. A speaker has a statement documented in it. A commentator has an opinion or editorial documented in it.