Skip to content
🚀 MCP Integration is now live
Learn More
Ctrl
K
esc
to close
to navigate
to select
Type to search documentation...
Home
Docs
Pricing
Changelog
Roadmap
Dark Mode
Get Started
Get Started
Docs
/
robots.txt
On this page
Share
Docs
/
robots.txt
Tag
robots.txt
1 article
Updated October 8, 2026
Articles
Optimise your docs for AI crawlers
Make it easy for ChatGPT, Claude, Perplexity, Gemini and other AI assistants to find, read and cite your documentation: robots.txt, structure, writing…
7 min read
October 8, 2026
No articles match this filter.
Ask AI
Copy
AI Assistant
Hi, how can I help.
Try asking about
Connecting an AI provider
Customising category pages
Import an OpenAPI file
Using tags
Loading...
Optimise your docs for AI crawlers
Listen
00:00
00:00
0.75×
1×
1.25×
1.5×