Paperpile Launches Citation Checker to Combat AI Hallucinations in Research
Key Takeaways
- ▸Paperpile's Citation Checker automates the verification of BibTeX citations, addressing a critical accuracy problem worsening despite advances in foundational LLMs
- ▸Hallucination rates in academic citations have reached ~0.4% of recent arXiv submissions and are increasing over time, driven partly by misuse of AI to auto-complete bibliographic metadata
- ▸Larger language models and web search tools significantly reduce but do not eliminate hallucinations, according to Paperpile's simulation study across model sizes and tool availability
Summary
Paperpile has released the Citation Checker, a free web tool designed to verify BibTeX files for hallucinated and incorrect citations before researchers submit preprints. The tool arrives at a critical juncture: recent large-scale analyses published in The Lancet and arXiv have revealed that approximately 0.4% of citations in recent arXiv submissions are hallucinated, with the problem worsening despite ongoing improvements to AI models.
The problem stems from researchers using large language models to auto-complete bibliographic metadata without verification. A case study from a NeurIPS submission illustrates the issue: authors used ChatGPT to convert paraphrased citations into BibTeX format, resulting in fabricated references that had to be manually corrected. Paperpile's research shows that while larger language models and web search tools reduce hallucination rates, they do not eliminate the problem entirely—model size has a substantial impact on performance, and tool availability provides only modest to significant improvements depending on the model.
The Citation Checker allows researchers to paste their BibTeX references and receive real-time verification, with results downloadable as corrected files or shareable via URL for collaboration. This practical solution directly addresses a growing threat to research integrity and scientific publishing standards.
- The tool is free and accessible to researchers, representing an immediate defense against citation hallucinations before manuscript submission
Editorial Opinion
Paperpile's Citation Checker tackles a genuine and escalating crisis in academic integrity. With hallucinations becoming more common despite model improvements, a free, accessible verification tool is both timely and necessary for the research community. However, the tool is ultimately a safeguard, not a solution: the real fix requires researchers to understand when and how to use AI responsibly in their workflows, and for journals to enforce stronger citation verification standards at the point of publication.
