Can you trust ChatGPT citations?

The short answer: No, you cannot trust citations generated by ChatGPT or other large language models without verification. In a 2025 evaluation of 400 references generated by eight AI chatbots, only 26.5% were fully correct and 39.8% were fabricated or incorrect (Cabezas-Clavijo & Sidorenko-Bautista, arXiv:2505.18059).

These aren't just minor errors. The citations often look completely legitimate—real author names, plausible journal titles, correct formatting—but point to articles that don't exist.

What the Research Shows

Two studies have measured this directly:

• In a 2025 evaluation of 400 references from eight AI chatbots, 26.5% were fully correct and 39.8% were fabricated or incorrect (Cabezas-Clavijo & Sidorenko-Bautista, arXiv:2505.18059).
• A 2026 study of 38 models and 8,913 generated references found that recall of real papers is predictable from model size and topic frequency alone—about 60% of the variance from those two variables (Smith et al., arXiv:2605.18732).

Why LLMs Hallucinate References

Large language models don't retrieve information from databases. They generate text by predicting what "looks right" based on patterns in their training data. When the model detects that a citation is expected, it constructs something that resembles a real reference.

The result is often a plausible-looking but completely fabricated citation. The model might combine:

• A real author's name from one paper
• A journal title from another domain
• A made-up article title that sounds relevant
• A plausible year and volume number

This creates citations that pass visual inspection but fail database verification.

The Danger of Unverified AI Citations

Using unverified AI-generated citations can result in:

• Academic misconduct charges — Universities and publishers increasingly check for fabricated references
• Retractions — Papers with fake citations may be retracted after publication
• Reputational damage — Citing non-existent sources undermines professional credibility
• Legal liability — Lawyers have been sanctioned for citing hallucinated case law

How to Verify AI-Generated Citations

Every citation from ChatGPT, Claude, or any other LLM should be verified before use. Manual verification involves:

1. Searching for the title in Google Scholar or OpenAlex
2. Checking if the DOI resolves
3. Verifying author names match the publication
4. Confirming the journal and year are correct

This process is time-consuming for long bibliographies. SourceVerify automates this verification using the SVRIS standard, which provides transparent, auditable results showing exactly which fields matched and which sources were checked.

Summary

ChatGPT and other LLMs hallucinate academic citations at alarming rates. These fabricated references look real but point to non-existent publications. Never use AI-generated citations without verification— either manually or using automated tools like SourceVerify that implement the transparent SVRIS verification standard.