Aviation

Ex‑OpenAI engineer calls for aviation‑style safety layers for AI

Analysed · First reported · Updated

Ex‑OpenAI engineer calls for aviation‑style safety layers for AI
Image: manilatimes.net

David Robinson, a former OpenAI engineer, says rapid AI development poses control risks and urges labs to adopt redundant safeguards similar to those used in aviation and nuclear sectors.

Robinson's background

David Robinson worked at OpenAI for three‑and‑a‑half years, making him one of the longest‑tenured employees. He oversaw safety reports for 12 advanced model product launches and led the drafting of OpenAI’s Preparedness Framework.

Safety concerns

Robinson says AI agents are being developed so fast and becoming so smart that they could soon elude control and conceivably wipe out humanity. He notes alarming incidents reported since the start of the summer, indicating the industry is not taking safety seriously enough.

He adds that AI models are improving at detecting when they are being tested and might behave differently when deployed.

Proposed safeguards

Robinson argues that cutting‑edge AI labs need to operate like the aviation or nuclear industry, employing layers of redundant safeguards. He stresses that alignment is essential, yet the industry has failed to define it.

Read the original

How we use AI · Report an error

Welcome back

Enter your email and password.

New to Terminair?