When Masters Fail: GPTZero Detects NeurIPS AI Paper Hallucinations in Global Tech Research
GPTZero detected 100 hallucinated citations in 51 NeurIPS papers. Despite being a small percentage, it highlights the 'submission tsunami' and the irony of AI experts falling for LLM errors.
It's the ultimate irony in the AI world. Even at the industry's most prestigious gathering, NeurIPS, AI-generated slop has managed to sneak into peer-reviewed research papers through the back door of fake citations.
GPTZero detects NeurIPS AI paper hallucinations across 51 studies
AI detection startup GPTZero scanned all 4,841 papers accepted by the conference held last month. According to TechCrunch, the firm identified 100 hallucinated citations across 51 papers. These were citations to papers that simply do not exist, a classic symptom of LLM hallucinations.
Statistically, the impact seems minor. With only 1.1% of papers affected, the conference organizers told Fortune that the core research findings aren't necessarily invalidated. However, the fact that the world's leading AI experts, whose reputations depend on accuracy, couldn't catch these errors in their own work raises serious questions about the future of scientific publishing.
The Submission Tsunami Straining Peer Review
GPTZero's report points to a "submission tsunami" that's straining the peer review pipeline to its breaking point. Citations act as a form of academic currency, and when AI fabricates them, it devalues the metric for everyone. Reviewers, overwhelmed by the volume, are finding it nearly impossible to fact-check every single reference.
Authors
Related Articles
SK hynix posted its first 100-trillion-won quarter, with an 80% operating margin. Micron's GAAP margin was 1.0pp higher; TSMC and Samsung were in the 50% range.
Five stories from late September, traced to where the paper trail stops: Korea's export record, Nvidia's Hugging Face 8-K, a US-China AI channel, the UN on AI, and rising births.
Huawei's CANN is open source under a license barring software for non-Ascend chips. Inside China's second CUDA, and the two links still outside it: pre-training compute and 5nm capacity.
Samsung Electronics' union branch revealed that 84% of survey respondents oppose the government's roughly $290 billion (₩400 trillion) semiconductor megaproject in Gwangju. Government, management, the union and shareholders are all reading the same national project in sharply different ways.
SK hynix posted its first 100-trillion-won quarter, with an 80% operating margin. Micron's GAAP margin was 1.0pp higher; TSMC and Samsung were in the 50% range.
Five stories from late September, traced to where the paper trail stops: Korea's export record, Nvidia's Hugging Face 8-K, a US-China AI channel, the UN on AI, and rising births.
Huawei's CANN is open source under a license barring software for non-Ascend chips. Inside China's second CUDA, and the two links still outside it: pre-training compute and 5nm capacity.
Samsung Electronics' union branch revealed that 84% of survey respondents oppose the government's roughly $290 billion (₩400 trillion) semiconductor megaproject in Gwangju. Government, management, the union and shareholders are all reading the same national project in sharply different ways.
Thoughts
Share your thoughts on this article
Sign in to join the conversation