OpenAI is transferring to publish the outcomes of its inner AI mannequin security evaluations extra commonly in what the outfit is saying is an effort to extend transparency.
On Wednesday, OpenAI launched the Safety evaluations hub, an internet web page exhibiting how the corporate’s fashions rating on numerous assessments for dangerous content material technology, jailbreaks, and hallucinations. OpenAI says that it’ll use the hub to share metrics on an “ongoing foundation” and that it intends to replace the hub with “main mannequin updates” going ahead.
“Because the science of AI analysis evolves, we purpose to share our progress on creating extra scalable methods to measure mannequin functionality and security,” wrote OpenAI in a blog post. “By sharing a subset of our security analysis outcomes right here, we hope this won’t solely make it simpler to know the protection efficiency of OpenAI methods over time, but additionally help neighborhood efforts to extend transparency throughout the sphere.”
OpenAI says that it might add further evaluations to the hub over time.
In current months, OpenAI has raised the ire of some ethicists for reportedly speeding the protection testing of sure flagship fashions and failing to release technical reports for others. The corporate’s CEO, Sam Altman, additionally stands accused of deceptive OpenAI executives about mannequin security evaluations previous to his brief ouster in November 2023.
Late final month, OpenAI was forced to roll back an update to the default mannequin powering ChatGPT, GPT-4o, after customers started reporting that it responded in an excessively validating and agreeable method. X turned flooded with screenshots of ChatGPT applauding all types of problematic, dangerous decisions and concepts.
OpenAI said that it could implement a number of fixes and modifications to stop future such incidents, together with introducing an opt-in “alpha part” for some fashions that will enable sure ChatGPT customers to check the fashions and provides suggestions earlier than launch.
Trending Merchandise
