Insights ยท Evidence
Does llms.txt Work? What the Data Shows
The file is harmless, but studies show no citation benefit.
What is llms.txt?
llms.txt is a proposed plain-text file, written in Markdown, that summarises a website and lists its most important pages for large language models.
Does it improve AI visibility?
The evidence so far says no. SE Ranking's November 2025 study of nearly 300,000 domains found that about 10% had the file and reported no effect on how often a domain was cited by AI systems. Server-log studies show AI crawlers rarely request it, and Google has said its Search systems do not use it.
We include an llms.txt file on this website because it costs nothing, but we do not sell it to clients as a ranking lever.
What matters more?
Access and content. OpenAI states that sites opted out of OAI-SearchBot will not be shown in ChatGPT search answers, so your robots.txt has a direct effect.
- Allow AI search bots such as OAI-SearchBot and Claude-SearchBot
- Check that your CDN or firewall is not blocking them
- Publish useful, original, well-sourced pages
- Earn mentions on trusted third-party sites
Sources
- Optimizely: Does llms.txt work?
- Google Search Central: Optimizing your website for generative AI features on Google Search
- OpenAI: Overview of OpenAI crawlers
- Search Engine Journal: Anthropic's Claude bots make robots.txt decisions more granular
Sources checked on . Third-party findings are reported as published and may be correlational.
Written by
Dr. Abaid Ahmad
Founder of Summit Digital Marketing. Fellow and Chartered Marketer (CIM, UK), Chartered Manager, PhD and MBA, with more than ten years of digital marketing using AI.
Next step
Find out what AI says about your business
Request a free AI visibility audit. You get a written summary and prioritised fixes within one business day of hearing from you.