OpenAI Pilots Embedded Third-Party Evaluation of Internal Monitoring System

Key Info

OpenAI invited METR and Redwood Research to pilot an embedded evaluation of its internal monitoring system, giving the teams deep infrastructure access for three weeks this summer. Their findings helped strengthen safeguards as the system was expanded and will shape future research collaborations with third-party evaluators.

Highlights

• Two employees from METR and Redwood Research worked on premises at OpenAI for three weeks.
• The team evaluated systems OpenAI uses to monitor internal agents for misalignment.
• A brief public write-up of the work is now available.
• Findings will inform future collaborations with METR and other third-party evaluators.