AI Engine Optimization (AEO)
Optimizing Content for LLM Crawlers
AI bots don't care about your website's CSS or visual layout. They care about raw text, structure, and factual density.
How LLM Crawlers Work
Crawlers like GPTBot (OpenAI) or ClaudeBot scan your site to build training data. They strip away heavy JavaScript and styling to extract the core text. If your text relies heavily on client-side rendering without proper HTML structure, the bots see a blank page.
The Factual Density Rule
- Semantic HTML: Use `h1`, `h2`, `article`, and `table` tags correctly.
- Clear Entities: Explicitly name your product and features. Avoid vague pronouns.
- Provide a `/llms.txt`: A dedicated markdown file summarizing your core documentation explicitly for AI consumption.
Analyze Your AEO with Igris Radar
Igris Radar analyzes your page exactly how an LLM crawler sees it, highlighting missing entities and poor semantic structure.
Test Your Content StructureHow to Fix It
- Audit: Use an AEO scanner to view your page as a bot.
- Structure Data: Implement JSON-LD schema markup.
- Clean Code: Ensure essential text loads without requiring JavaScript interaction.