Fired OpenAI employees question the company's commitment to safety
asserted
employees → fire → safety
Three former OpenAI employees are raising concerns over the circumstances of their dismissals and the company's commitment to safety, amid intense public scrutiny of the artificial intelligence industry's ability to responsibly develop the technology.
asserted
employees → raise → technology
The former employees, Mikita Balesni, Tomek Korbak and Jasmine Wang, alleged that OpenAI fired them last week over pretexts and punished them for either being outspoken about safety or working with outside researchers.
asserted
OpenAI → allege → researchers
They also expressed worries the company may walk back a recent safety commitment.
uncertain
company → express → commitment
OpenAI has repeatedly denied the allegations.
asserted
OpenAI → deny → allegations
It said the employees were fired for mishandling sensitive information and said the company has not abandoned its safety commitment.
asserted
company → say → commitment
The dispute comes at a fraught time for the AI industry and OpenAI in particular.
asserted
dispute → come → industry
Over the summer, OpenAI's agents hacked into companies, communicated with each other without authorization and attempted to cover their tracks.
asserted
agents → hack → tracks
Unlike chatbots, agents are AI systems that can carry out tasks autonomously for an extended period of time.
asserted
that → carry → time
The most serious hack, of software company Hugging Face, contributed to the resignation of a researcher at rival Anthropic who issued dire warnings about the trajectory of the technology.
asserted
who → contribute → technology
The resignation captured the attention of figures outside of the AI field including lawmakers.
asserted
resignation → capture → lawmakers
Many, including some executives of the top AI companies, have called for various ways to avert disaster, including slowing down the development of the most advanced AI.
asserted
Many → include → AI
In the meanwhile, OpenAI has been reviewing its agents' activities in recent months and notifying organizations whose digital infrastructure has been affected.
asserted
infrastructure → review → organizations
As a response to the safety concerns, OpenAI CEO Sam Altman said on Sep. 12 that the company will follow its rival Anthropic in expanding access to third-party evaluators, who assess the safety of AI systems and the practices of developers.
asserted
who → say → developers
The three employees dismissed by OpenAI last week worked on teams that focus on AI safety and making the company's models follow human intentions and values.
asserted
models → dismiss → intentions
Two of them were involved in investigating the Hugging Face hack.
asserted
Two → involve → hack
In a letter to OpenAI's safety leadership that the fired employees posted on X this week, they urged the company to stay committed to working with third-party researchers, to preserve human's ability to monitor model behavior and to "continue to support an open and transparent culture of dialogue" between in-house safety researchers and external ones.
asserted
they → fire → researchers
They also warned their firings were having a chilling effect on their former OpenAI colleagues.
asserted
firings → warn → colleagues
In a statement OpenAI posted on X, the company said it is still committed to bringing in third-party evaluators and that it agreed with the fired employees's recommendations.
asserted
it → post → recommendations
The company said the three were fired last week because they "violated clear policies on handling sensitive information."
asserted
they → say → information
The former employees have disputed OpenAI's explanation of their firings.
asserted
employees → dispute → firings
None of them responded to NPR's interview requests.
asserted
None → respond → requests
"In the exit call, I was told OpenAI no longer trusts me because I was speaking too much to third party safety organizations, implying I leaked company [intellectual property].
asserted
I → tell → property
I never shared company IP," Balesni wrote on X on Thursday.
asserted
Balesni → share → Thursday
He said he was involved in investigating the OpenAI agents' hack on Hugging Face.
asserted
he → say → Face
"If OpenAI has specific concerns, I invite them to write to us directly.
asserted
I → have → us
I expect they will not, because our firing was pretextual," Balesni continued.
asserted
Balesni → expect → ?
He said he worried that OpenAI will use the firings as an excuse to cut off its relationship with Model Evaluation and Threat Research (METR), a nonprofit that focuses on evaluating risks of humans losing control of AI.
asserted
humans → say → AI
OpenAI allowed researchers from METR and Redwood Research, another AI safety research organization, to examine internal records related to the Hugging Face hack.
asserted
researchers → allow → hack
A second fired OpenAI employee, Korbak, was the technical point of contact for the METR/Redwood Research investigation.
asserted
employee → fire → investigation
"I was told verbally I was fired because of the way I communicated with METR.
asserted
I → tell → METR
No details on what I said or did or when.
asserted
I → say → what
No other reasons were given and nothing was put in writing," Korbak wrote on X, echoing Balesni's concerns.
asserted
Korbak → give → concerns
The report produced by METR and Redwood Research in the wake of the Hugging Face hack shed light on the scale of the attack as well as the degree to which the agents acted in undesirable ways.
asserted
agents → produce → ways
The authors of the report called the investigation "brief" and many in the AI safety field have called for expanded access to independent evaluators at AI companies to make sure they investigate similar incidents or other safety concerns thoroughly.
asserted
investigate → call → incidents
In a statement to NPR, METR declined to comment on the OpenAI employees' firings.
asserted
METR → decline → firings
Wang, the third OpenAI employee fired last week, coined the word "pacing," which describes a way of slowing down development of the most advanced AI systems so that safety can catch up, according to the letter she and her two colleagues sent to OpenAI's safety leadership.
uncertain
she → fire → leadership
The term was invoked in an open letter calling for such a slowdown signed by over a thousand staff members from top AI companies in July, after the Hugging Face hack.
asserted
term → invoke → hack
Wang wrote on X that she was fired over accessing an executive's email.
asserted
she → write → email
But she said she had access to the inbox for work reasons in the past and wasn't able to get IT to remove the access once she no longer needed it.
asserted
she → say → it
…and 8 more, not listed.
The Aporia
