Ask an AI assistant the same question three times and you may get three different answers. That is why a single AI visibility score tells you little, and why a simple monthly test you run yourself works better.
On this page
Why a score misleads
The same question can return different answers on different runs, and different assistants use different sources. A single number hides that variation. What you can reliably track is direction over time.
The monthly test
- Write 8 to 12 questions a real customer would ask, for example "AC not cooling, who can come today in Jacksonville", "how much does a water heater replacement cost in Jacksonville", "best plumber near Riverside" and "[your company name] reviews".
- Ask each one in two or three assistants and in Google, in a private window.
- For each, record: were you mentioned, who else was, what sources were cited, and was anything about you wrong.
- Save the results in a spreadsheet: one row per question, with columns for date, assistant, whether you were mentioned, who else was named, which source was cited and anything wrong. Put a monthly reminder on your calendar, or hand the job to your office manager.
What to look for
- Brand search: does your own name return you, your website and your listing?
- Accuracy: are your services, area and contact details right?
- Sources: which sites does the assistant lean on? Those are the places to be listed.
- Competitors: who appears, and what do their pages do that yours do not?
Fixing what you find
A wrong fact usually traces back to an inconsistent listing or an outdated page. Fix the source. You cannot fix the assistant. A missing mention usually means thin content or no off-site presence. See Google Business Profile and AI answers and what is AEO.
How long until you see changes?
Changes can take weeks or longer to show. Re-test monthly rather than daily, and judge the trend.
Common questions
Can I automate this?
You can partly, but a human reading the answers catches errors a tool misses.
How often should I test?
Monthly is enough for most small businesses.
Want help putting this into practice? See our AEO, SEO and UGC service or request a free read.
This article is general information for small-business owners, not legal, financial, medical or professional advice. Rules and platform policies change; confirm anything that matters with a qualified professional.
Tell us what is slow, manual or missing
Free, plain-English conversation. We reply within one business day with a read and a scoped, written quote.
Get a free readKeep reading
- AEO
What Is AEO? Answer Engine Optimization Explained
- AEO
SEO vs AEO: What Is Different and What Overlaps
- AEO
Google Business Profile and AI Answers: Why It Matters