Robots and Meta Tester
Check if pages are crawlable and indexable by combining robots.txt analysis with meta robots and X-Robots-Tag tests.
Step 1: Fetch URL Data
Step 2: Review and Test
Crawl Access
-
Matched Group
-
Meta Index
-
Meta Follow
-
Fetch a URL to begin
Enter a page URL and click fetch to pull robots.txt, meta robots, and X-Robots-Tag values.