An AI hallucination is an answer that sounds certain and is wrong. Ask an AI tool about your refund policy and it may state one with total confidence, even if you have never had such a policy. Any business using AI should plan for it.
On this page
What a hallucination is
Language models generate likely-sounding text. They do not look facts up unless they are connected to a source. When the model lacks information or the question is ambiguous, it can still produce a fluent answer that is invented or outdated.
Where it hurts a small business
- A chatbot quoting a price or policy that does not exist.
- A drafted email stating a wrong date or promise.
- A public assistant describing your business incorrectly, for example the wrong service area.
- A summary that quietly changes a number.
Safeguards that work
- Ground answers in your own information. Limit an assistant to approved content instead of letting it improvise.
- Limit what it may say. It should not quote prices, make promises or give legal, medical or financial advice. When a customer raises those topics, it hands off to a person.
- Hand off to a person when it is unsure or the topic is sensitive.
- Review before anything goes live, and sample live conversations afterwards.
- Log and correct. When it errs, fix the source information.
When others get it wrong about you
If an outside assistant misdescribes your business, the fix is usually at the source: clear, consistent facts on your site, structured data and listings. See how assistants choose sources.
The takeaway
Treat AI output as a draft from a fast but unreliable assistant. Verify before you rely on it. See why every automation needs a human in the loop.
Common questions
Can hallucinations be eliminated?
Not entirely. They can be reduced and contained with the safeguards above.
Does a bigger model never hallucinate?
No. Better models err less often, but no model is error-free.
Want help putting this into practice? See our AI strategy and cost service or request a free read.
This article is general information for small-business owners, not legal, financial, medical or professional advice. Rules and platform policies change; confirm anything that matters with a qualified professional.
Tell us what is slow, manual or missing
Free, plain-English conversation. We reply within one business day with a read and a scoped, written quote.
Get a free readKeep reading
- AI for business
Human in the Loop: Why Every AI Automation Needs Review
- AI for business
Good vs Bad AI Practices for Small Business
- AEO
How AI Assistants Find and Choose Sources