Methodology

How AEO Corner measures AI visibility

Black-box scores are hard to trust. This page explains exactly what we collect, how we read it, and how every number is calculated, so you can check our work.

Version 2 · 4 October 2026

1. Principles

  1. We measure what people see, and label where it came from. An answer captured from a chat interface and one produced by an API with web search can differ, so every answer we store is tagged with how it was collected.
  2. AI answers are random. Ask the same question twice and you can get two different answers. We ask several times and report rates with a margin of error, never a single yes or no.
  3. We keep the raw answer. Every number is derived from stored raw answers, so when our reading of answers improves we can recompute history instead of guessing.
  4. We keep cause and outcome apart. Readiness is what your site does to help AI find and quote you. Visibility is what AI answers actually say. They are scored separately because one does not guarantee the other.
  5. A failed check is never a zero. If we couldn’t collect an answer, it is shown as “Couldn’t check” and left out of rates. It is never counted as “not mentioned”.

2. Engines and how we collect answers

We buy answers from licensed data providers and use official APIs. We do not scrape consumer AI apps ourselves.

Engines, collection method and samples per run
EngineHow the answer is collectedSamples per question
ChatGPTLicensed capture of the ChatGPT interface, logged out and not personalised, including the sources it shows.3
GeminiLicensed capture of the Gemini interface.3
PerplexityThe official Perplexity API, which returns the sources it cites. Labelled “API-grounded”.3
Google AI OverviewsA search-results data provider, using the keyword form of the question. Not every search shows an AI Overview, so we also track how often one appears.1

If a provider is down we wait and retry for several hours; if it is still down, those answers are shown as “Couldn’t check” and the week is marked incomplete, rather than guessed. We do not yet switch to a backup provider. The free audit asks each question once; ongoing tracking asks three times.

3. Sampling and statistics

  • Mention rate for a question on an engine is the number of samples that name your brand divided by the number of samples collected.
  • Ranges. Rates across many questions are shown with a 95% Wilson confidence interval, drawn as a band on charts.
  • Change detection. We compare the last four weeks with the four weeks before. A change is called significant only if a two-proportion z-test gives p < 0.05 and the change is at least 5 percentage points. Anything else is labelled “within normal variation”.
  • Why this matters. Single-sample tools swing wildly from week to week. Honest handling of that noise is the difference between a dashboard you can act on and one that makes you panic.

4. Sample sizes

How sure a rate is depends on how many answers stand behind it. These are the numbers we work with:

  • The free audit asks five questions on four engines, once each: at most 20 answers. That is enough to show you real answers and where to look, not to put a percentage on anything.
  • Ongoing tracking asks every question three times on each engine (once for Google AI Overviews), every week. A project with 50 questions collects about 150 answers per engine per week.
  • Why the range matters. If half of the answers name you, 20 answers put the true rate somewhere between roughly 30% and 70%. With 150 answers the range narrows to roughly 42% to 58%. We show the range, so a small sample looks as uncertain as it is.
  • Minimum for a verdict. We call a change significant only when each of the two four-week windows holds at least 20 answers. With fewer, the dashboard says “not enough data”, never “no change”.
  • Outages are not your decline. A day on which an engine did not finish cleanly is left out of that engine’s windows, so our outage is never reported as a drop in your visibility.

5. Reading the answers

  1. Matching. A deterministic first pass finds your brand, its aliases and your domain in the answer, and parses the sources the engine cited.
  2. Understanding. A language model reads each answer into a structured record: the type of answer (list, single recommendation, comparison, explanation or refusal), every brand named, its position, how prominent it is, whether it is recommended or cautioned against, sentiment, and the claims made about it.
  3. Cross-check. The matching pass and the model must agree on whether your brand is present. Disagreements go to a review queue and are used to improve the system.
  4. Versioning. Every derived number records which version of the reader produced it, so history can be re-read from the raw answers.

6. What we measure

Metric definitions
MetricDefinition
Mention rateShare of answers that name your brand.
Share of voiceYour mentions divided by mentions of everyone you track (you and your competitors).
Recommendation rateShare of answers that actively recommend you.
Average positionYour average place in list-style answers, when you are named.
Citation shareCitations that point to your domain divided by all citations.
SentimentAverage sentiment of the mentions, from −2 (negative) to +2 (positive).
Win rate vs a competitorShare of questions where you rank ahead of them, or they are absent and you are present.
AI Overview trigger rateShare of searches that show an AI Overview, and how often those overviews mention or cite you.

7. The AI Visibility Score

The score is a weighted average, from 0 to 100, of how prominently you appear in each answer. For every question p and engine e, we average the presence value over the samples:

Presence value for one answer
What the answer doesPresence value
Recommends only you, or lists you first1.00
Lists you second0.85
Lists you third0.70
Lists you fourth or lower, or mentions you outside a list0.50
Cites your website but does not name your brand0.25
Does not mention you0.00

If the answer cautions against you or does not recommend you, the value is halved. The score is the average of these values, weighted by how important each question is (priority 1–3) and by engine weight (equal by default), multiplied by 100. Answers we couldn’t collect are left out of the average, not scored as zero.

8. The AEO Readiness checklist

Readiness scores the signals on your own site that help AI find, read and trust you. These weights are our first version (v0): reasoned heuristics that have not yet been tested against outcomes. Once we have enough customer data we will calibrate them against real results and publish what changed.

Readiness categories and points
CategoryWhat we checkPoints
A. AI crawler accessAnswer and search bots are allowed in robots.txt; no firewall or CDN challenge blocks them; a sitemap exists. Training-bot policy is shown for information and is your business choice.20
B. RenderabilityYour main content is in the HTML a crawler receives, not only after JavaScript runs.10
C. Structured dataOrganization and page-type schema on key pages, valid and server-rendered, plus site and breadcrumb markup.20
D. Entity clarityConsistent brand name, a clear About page, links to authoritative profiles, consistent name/address/phone for local businesses.15
E. Content answerabilityQuestion-style headings, a short direct answer under each, lists and tables, FAQs, evidence with sources, and visible freshness.25
F. Technical foundationsKey pages are indexable, served over HTTPS without redirect chains, with unique titles and descriptions. An llms.txt file earns a point but is low weight because major engines have not confirmed they use it.10

9. The free audit’s AEO Score

The free audit combines the two parts: AEO Score = 0.6 × Readiness + 0.4 × Visibility. The report always shows both parts separately. The audit’s visibility part is a one-answer-per-question snapshot, so it is directional. Ongoing tracking, with repeated sampling, is what you should use to measure change.

10. How we judge a fix

A fix is checked twice, and the two checks answer different questions:

  • Is it live? For a change to your site, we look at the page again: straight away, after an hour and after a day. We check that the page exists, can be indexed, shows its headline and carries its structured data. If we cannot look, we say “couldn’t check”, never “still failing”.
  • Did AI answers change? We compare the complete answers collected before the fix with those collected after it, at two and four weeks, using the same significance rule as the dashboard. The verdict is a gain, a decline, no change, or not enough data yet. A change inside normal variation is labelled that way.
  • What a verdict is not. It shows that answers changed after the fix, not that the fix caused the change. Other things move at the same time: your competitors, the engines’ own models and what is published about you elsewhere. We show the numbers so you can judge for yourself.

11. Known limits

  • An answer is one person’s view on one day. Engines personalise by location, history and time. Ours are collected logged out and not personalised, so they will not match what every one of your customers sees.
  • Collection methods differ. A captured chat answer and an API answer can differ, even for the same question. Every answer is labelled with how it was collected, and you should compare like with like.
  • Reading answers is not perfect. Matching and the language model sometimes disagree, and either can be wrong. Disagreements go to a review queue and you can report an answer that was misread. We have not yet published accuracy figures for the reader; we will when our hand-checked test set is large enough to make them meaningful.
  • The readiness weights are untested. They are our first version. They are reasoned, not yet checked against outcomes.
  • Small sites get wide ranges. If few answers name any brand in your market, the rates move a lot and the range stays wide. We would rather show that than a confident number.
  • We cannot promise results. AEO Corner measures what AI engines say. It cannot guarantee to change it.

12. What we will not do

These are limits we put on ourselves, because durable AEO should not put your brand at risk:

  • Fake reviews, testimonials or invented statistics.
  • Hidden text, or content shown only to bots.
  • Automated posting on Reddit, Quora or similar communities.
  • Mass-published AI articles. Content we help you write needs human approval and passes quality checks first.
  • Buying links or using other people’s sites to rank yours.

13. References

The standards and methods this page relies on:

14. Version history

  • Version 2 — 4 October 2026. Added sample sizes, how we judge a fix and our known limits. Corrected the engines section: there is no automatic backup provider yet; an engine that is down is shown as “Couldn’t check”.
  • Version 1 — 2 October 2026. First public version.

When this method changes, we will add a dated note here saying what changed and why.

Free AEO audit

See what AI says about your brand

Enter your website and get a real report in about five minutes: your AEO Score, the actual answers AI gave, and your top five fixes.

Compare with a competitor (optional)

Free · about 5 minutes · no account or credit card needed.