Inspect HTML robots meta tags and X-Robots-Tag response headers.
Use the Meta Robots Checker
What this tool helps you check
A page can send indexing instructions through HTML and HTTP headers. This checker retrieves a public URL and displays the meta robots directives it finds alongside the X-Robots-Tag header. It highlights noindex and nofollow when present.
How to use it
- Enter a public page URL
- Read directives in both the page head and response header
- Compare with the intended indexing and link-following policy
Interpreting the result
Robots.txt access can prevent a crawler from reading page-level directives. Directives may differ by user agent or response status; this check represents one public request.
Limitations and next steps
What is the difference between noindex and nofollow?|Noindex requests that a page not appear in results; nofollow requests that links on the page not be followed.
Related free tools
Continue with Robots.txt Tester, Redirect Checker, Canonical Tag Checker or browse all free tools.