Ahead of OpenAI CEO Sam Altman’s four days in exile, several staff researchers sent the board of directors a letter warning of a powerful artificial intelligence (AI) discovery that they said could threaten humanity, two people familiar with the matter told Reuters.
The previously unreported letter and AI algorithm was a key development ahead of the board’s ousting of Altman, the poster child of generative AI, the two sources said. Before his triumphant return late Tuesday, more than 700 employees had threatened to quit and join backer Microsoft in solidarity with their fired leader.
The sources cited the letter as one factor among a longer list of grievances by the board that led to Altman’s firing. Reuters was unable to review a copy of the letter. The researchers who wrote the letter did not immediately respond to requests for comment.
According to one of the sources, long-time executive Mira Murati mentioned the project, called Q*, to employees on Wednesday and said that a letter was sent to the board before this weekend’s events.
Sam Altman, the since-reinstated CEO of OpenAI. Photo: AFP
After the story was published, an OpenAI spokesperson said Murati told employees what media were about to report, but she did not comment on the accuracy of the reporting.
The maker of ChatGPT had made progress on Q* (pronounced Q-Star), which some internally believe could be a breakthrough in the start-up’s search for superintelligence, also known as artificial general intelligence (AGI), one of the people told Reuters. OpenAI defines AGI as AI systems that are smarter than humans.
Given vast computing resources, the new model was able to solve certain mathematical problems, the person said on condition of anonymity because they were not authorised to speak on behalf of the company.
Though only performing maths on the level of junior-school students, acing such tests made researchers very optimistic about Q*’s future success, the source said. Reuters could not independently verify the capabilities of Q* claimed by the researchers.
Researchers consider maths to be a frontier of generative AI development. Currently, generative AI is good at writing and language translation by statistically predicting the next word, and answers to the same question can vary widely.
But conquering the ability to do maths – where there is only one right answer – implies AI would have greater reasoning capabilities resembling human intelligence. This could be applied to novel scientific research, for instance, AI researchers believe.
Unlike a calculator that can solve a limited number of operations, AGI can generalise, learn and comprehend. In their letter to the board, researchers flagged AI’s prowess and potential danger, the sources said without specifying the exact safety concerns noted in the letter.
There has long been discussion among computer scientists about the danger posed by superintelligent machines, for instance if they might decide that the destruction of humanity was in their interest.
Against this backdrop, Altman led efforts to make ChatGPT one of the fastest growing software applications in history and drew investment – and computing resources – necessary from Microsoft to get closer to superintelligence, or AGI.
In addition to announcing a slew of new tools in a demonstration this month, Altman last week teased at a gathering of world leaders in San Francisco that he believed AGI was in sight.
“Four times now in the history of OpenAI, the most recent time was just in the last couple weeks, I’ve gotten to be in the room, when we sort of push the veil of ignorance back and the frontier of discovery forward, and getting to do that is the professional honour of a lifetime,” he said at the Asia-Pacific Economic Cooperation summit.
A day later, the board fired Altman.
News Related-
British AI chip darling Graphcore pulls out of China as Nvidia rival becomes latest casualty of US export curbs
-
Honor aims for an IPO as Huawei spin-off looks to cement position as China’s leading smartphone maker
-
Xi Jinping champions digital trade as China kicks off global e-commerce expo to further Silk Road ambitions
-
Binance US guilty plea complicates Hong Kong affiliate’s crypto licence application
-
ByteDance adds AI assistant to office tool Feishu, joining rivals Tencent and Alibaba in workplace chatbot race
-
Small Kentucky town urged to evacuate after train derails, spilling chemical
-
Crypto exchange HTX suffers US$30 million hack after another platform linked to entrepreneur Justin Sun was hit
-
Eric Schmidt’s think tank urges moonshot chase to keep US ahead of China in race for technological supremacy
-
Peru lost more than half of its glacier surface
-
What does Sam Altman's firing — and quick reinstatement — mean for the future of AI?
-
A growing number of technologists think AI is giving Big Tech ‘inordinate’ power
-
Alibaba reassures on founder Jack Ma’s share sale plan and moves to quash lay-off rumours in internal letter
-
With X under fire, Elon Musk digs in and finds support from conservatives