The smaller, faster o4-mini model did worse, hallucinating 41% of the time on PersonQA and 79% on SimpleQA. The newer GPT-4.5 model, released in February, performed better, with a 37.1% hallucination rate on SimpleQA. OpenAI publishes the latest results of these and other tests on its Safety evaluations hub.
“The increase in hallucinations by reasoning models may very well be due to AI overthinking,” said Brandon Purcell, a vice president and principal analyst at Forrester Research.
Forrester’s research data aligns with other scrutiny into AI trust: Over half of business leaders worry about generative AI, slowing adoption and limiting its value, according to the research firm. To close this trust gap, companies should demand transparency, invest in explainable and traceable AI, and monitor performance in real time, Purcell said.
Read the full article here
