Overview
The learner can ensure a site is reliably crawled, indexed and readable by both search and AI engines.
Foundation level
Learning objectives
- Diagnose the indexability and crawl issues that suppress visibility
- Configure access for search and AI crawlers deliberately rather than by default
- Prioritise technical fixes by the traffic and citations at risk
Lesson outline
- Crawl, render and index: the pipeline every page passes through
- Robots directives, llms.txt and AI crawler access
- Core Web Vitals and rendering for machine readability
- Reading a technical health scan and triaging findings
- Building a durable technical baseline before optimising content