← All research

ChatGPT Citation Gap: Why Your Tracking Tool Only Sees a Quarter of the Pages

ChatGPT citation gap explained: Google and the API found only about 26% of cited pages. Learn what to track and how to fix your AI visibility.

The ChatGPT citation gap is the difference between the sources observed in ChatGPT and those recovered by an outside tracking method. In one 2026 study, Google results plus the OpenAI API recovered 26.2% of the cited URLs for GPT-5.5 Instant and 48.7% of cited hostnames. These are study-specific results, not a performance estimate for every tracking tool.

If you plan content, write client reports, or set budgets from these numbers, the gap can send you the wrong way. Here is what it is, why it happens, and what to do about it.

Quick Answer

The ChatGPT citation gap is the mismatch between observed ChatGPT citations and external proxy results. An October 2026 preprint found that Google results and Responses API candidates together recovered 26.2% of cited URLs and 48.7% of cited hostnames for GPT-5.5 Instant. Compare URLs, hostnames and brands, repeat prompts, and record the model and collection method.

What Is the ChatGPT Citation Gap?

The ChatGPT citation gap is the mismatch between the sources ChatGPT shows in an answer and the sources your report says it used. It is a data problem, not a ranking problem.

Picture this. You ask ChatGPT for the best payroll software for small shops. It shows eight links. Your report, built from another data feed, also lists eight links. But only two are the same pages. Your team now thinks a rival blog post is winning, while the page ChatGPT really used sits somewhere else.

This matters because teams use these numbers to judge their AI visibility, decide what to write, what to fix, and what to tell clients. Wrong input leads to a wrong plan.

Why Do Tools Miss So Many ChatGPT Citations?

Some citation trackers use proxies such as search results or API responses rather than observing the exact ChatGPT session a person saw. Different systems can return different pages for the same question. Ask each provider how its data is collected; this study did not evaluate commercial tracking products.

Researchers at the National University of Singapore and Xi'an Jiaotong University tested this in a preprint posted on arXiv on October 11, 2026. They recorded the data stream the ChatGPT web app received in their own signed in sessions. That showed which searches ChatGPT ran, which pages came back, and which pages it chose as sources. Then they compared that record with Google results and with OpenAI's Responses API with web search turned on.

Neither stand in matched ChatGPT page for page. Two cautions are fair here. A preprint has not gone through peer review. And the study did not test any paid tool. So it does not prove that your own tracking tool has this exact gap. It shows what happens when a tool leans on this kind of data, and it tells you what to ask.

How Big Is the Gap in Real Numbers?

The tested proxies recovered more cited hostnames than exact URLs. For GPT-5.5 Instant, their combined recall was about one quarter at URL level and nearly half at hostname level. Hostnames distinguish subdomains; they are not necessarily equivalent to an entire registered domain.

The test used 80 sampled user questions: 40 in English and 40 in Chinese. GPT-5.3 Instant and GPT-5.5 Instant each had 20 runs per question, collected between March 29 and July 29, 2026. The following figures are recall values from Table 4 of the original paper. Its citation sets include selected references and attached supporting pages, rather than only separately displayed links.

Data sourceCited URLs recovered (GPT-5.3 Instant)Cited URLs recovered (GPT-5.5 Instant)Cited hostnames recovered (GPT-5.3 Instant)Cited hostnames recovered (GPT-5.5 Instant)
Google results alone9.4%6.4%26.1%22.8%
API full source list22.9%22.5%38.3%38.1%
Google plus API28.3%26.2%50.3%48.7%

Recall and precision answer different questions. The full API candidate list recovered more of ChatGPT's cited pages, while the API's own citations had higher precision. URL precision for API citations was 23.3% with GPT-5.5 Instant and 16.4% with GPT-5.3 Instant. Those percentages use the API citation set as the denominator; they are not the recall values in the table.

Why Do ChatGPT Citations Change Between Runs?

Repeated requests can retrieve different source candidates. A page appearing in a candidate pool is not proof that the final answer cited it.

In the study, 44.5% of distinct URL candidates for GPT-5.5 Instant appeared in only one of 20 runs, compared with 40.8% for GPT-5.3 Instant. These are retrieval-candidate statistics, not percentages of citations appearing once. Hostname-level overlap was more stable than exact-URL overlap.

A separate SISTRIX analysis reported a 47% shift in the distribution of cited domains in German-language responses within 48 hours around the May 22–23, 2026 model change. Its preceding comparison values were 1–2%. That result describes its own market, sample and period, not a universal daily volatility rate.

So one check tells you very little. A single screenshot of "we got cited" or "we did not" is a snapshot, not a trend.

Why Your Exact Prompt Is Not What ChatGPT Searches

ChatGPT can rewrite a question into search queries and sometimes split it into several related searches, often called query fan-out. The study found substantial differences between its observed model settings.

In the observed runs, neither GPT-5.3 Instant nor GPT-5.5 Instant searched with exactly the original question wording. GPT-5.2 Instant did so in 5.5% of observed runs. For Chinese questions, 67.0% and 69.6% of runs respectively used English-only searches in the two later Instant settings. These results should not be generalized to all future requests.

This changes how you should write. In its study of 1.4 million prompts, Ahrefs found that cited pages matched ChatGPT's own sub questions more closely than the original prompt. A page that answers the follow up questions around a topic has a better shot than a page that only repeats the main question. That is a pattern, not a promise.

Being Found Is Not the Same as Being Cited

ChatGPT can pull in a page and still leave it out of the final answer. The paper's authors say GEO work should treat retrieval visibility and citation visibility as two different things.

Ahrefs separately reported that ChatGPT cited about half of its retrieved URL candidates. It also reported that about 88% of cited URLs came through the general search retrieval category. This does not identify Google as the underlying search provider, and a retrieved candidate was not necessarily opened and read in full.

What this means for you: if a tool only tells you that a page "appeared", ask whether ChatGPT showed it as a source. A page in the pool is not a page in the answer.

How to Track ChatGPT Citations Without Fooling Yourself

To track ChatGPT citations well, measure sites and brands as well as exact pages, repeat every prompt, and note which model gave each answer. These steps follow what the study's authors suggest.

  1. Track at several levels. Record exact URLs, hostnames, and brand or entity mentions separately. Hostname-level data was more stable in the study, but mentions and citations still measure different outcomes.
  2. Run each prompt many times. The researchers used 20 runs per question. There is no magic number, but more runs give a calmer picture.
  3. Write prompts like real people. Use questions your buyers ask, then add the follow up questions they ask next.
  4. Log the model and the date. Two data sessions in the study switched models partway through. If you do not log the model, you cannot explain a sudden jump.
  5. Test again after model changes. Treat every new ChatGPT release as a reason to check your numbers.
  6. Use the data to write. Look at the sub questions around your topic and fill the holes with clear, direct answers.

Before you pick a tracking platform, ask the seller five plain questions:

  • Does the data come from the ChatGPT app, the API, or Google?
  • How many times is each prompt run?
  • Can I see results by site as well as by page?
  • Does it record which model gave each answer?
  • Does it say what it cannot see?

If you want a place to begin, a GEO tool can show where your brand appears across AI answers today, so you have a baseline before you change anything.

Final Thoughts

The citation gap is not a reason to stop measuring. It is a reason to measure with care. Use page data as a clue, use site data as your steady guide, and repeat your checks. The study covered models from GPT-5.2 to GPT-5.5, and newer models may behave differently, so keep testing.

Frequently Asked Questions

Does the ChatGPT API give the same sources as the ChatGPT app?

Not exactly. In the study, the API matched ChatGPT better than Google did, but it still missed most exact pages. It was a closer match at the site level than at the page level.

Does the 26% number apply to every tracking tool?

No. The researchers tested Google results and OpenAI's API as stand ins. They did not test any paid tool, and the paper is a preprint. Ask your tool's team how its data is collected.

How many times should I run a prompt?

The study ran each question 20 times. There is no number that guarantees a perfect picture. More runs give a steadier view, and a single run can mislead you.

Will the gap look the same on newer ChatGPT models?

The cited study does not establish that. It examined four settings spanning GPT-5.2 to GPT-5.5, with different sampling coverage. Recheck current models under documented conditions rather than assuming the same gap.

Can I make sure ChatGPT cites my page?

No. Citations change from run to run, and nobody can promise them. You can improve your chances by answering the sub questions around your topic in clear, direct words.

What is the difference between a mention and a citation?

A mention is when ChatGPT names your brand in its answer. A citation is when it shows your page as a source. A brand can have one without the other, so track both.

Review mentions, citations and comparable evidence before deciding what to change.

Explore the RankinLLM demo