Meta Robots & X-Robots-Tag Tester
Test and analyze meta robots directives. Parse HTML meta tag or X-Robots-Tag header, validate directives (index/noindex/follow/nofollow/noarchive/nosnippet), detect conflicts, generate recommendations, output a fixed tag. Reference table, history (localStorage), shareable URL. 100% client-side.
About Meta Robots & X-Robots-Tag Tester
Test and analyze meta robots directives. Parse HTML meta tag or X-Robots-Tag header, validate directives (index/noindex/follow/nofollow/noarchive/nosnippet), detect conflicts, generate recommendations, output a fixed tag. Reference table, history (localStorage), shareable URL. 100% client-side. Everything runs locally in your browser — your data never leaves your device.
How to use
- Enter your input in the tool above.
- Adjust any options to your preference.
- Use the Copy or Download buttons to save the result.
- Everything happens locally — your data never leaves your browser.
FAQ
What directives does the tester support?
index, noindex, follow, nofollow, noarchive, nosnippet, notranslate, noimageindex, unavailable_after, max-snippet, max-image-preview, max-video-preview, all, none. Both the HTML meta tag and the HTTP X-Robots-Tag header are supported.
How does it detect conflicts?
It flags errors for mutually exclusive pairs (index+noindex, follow+nofollow, all+none) and warnings for redundant combinations (all + restrictive directives, none + permissive directives). It also validates unavailable_after requires a date and max-image-preview must be one of none/standard/large.
What does the 'fixed tag' do?
It generates a corrected <meta name='robots' content='...'> tag that resolves any conflicts by preferring the restrictive directive. For example, index+noindex becomes noindex, follow+nofollow becomes nofollow.
What is the X-Robots-Tag header?
An HTTP response header that applies the same directives as the meta tag. Useful for non-HTML files (PDFs, images) where you can't add a meta tag. Format: 'X-Robots-Tag: noindex, nofollow'.
What extra features does this tool have compared to others?
(1) Directive parsing for all 14 directives. (2) Conflict detection (index+noindex, all+none, etc.). (3) Recommendation engine. (4) X-Robots-Tag header support. (5) HTML meta tag auto-extraction. (6) Fixed tag generation. (7) Plain-text report copy. (8) Full directive reference table. (9) History (localStorage, last 20). (10) Shareable URL.
Is my data sent anywhere?
No. All parsing runs locally. History is stored in localStorage on this device only.
Related tools
Affiliate Commission Calculator
Calculate affiliate commissions across four program types — flat percent, tiered percent (progressive brackets), recurring (monthly × N months), and hybrid (initial + recurring). Apply refund-rate and tax-withholding adjustments, compute effective commission rate, compare two program types side-by-side, and project break-even sales to hit a target income. History (localStorage) + shareable URL. 100% client-side.
Affiliate Link Cloaker & Redirect Generator
Cloak affiliate links into pretty URLs and generate redirect scripts (PHP, JavaScript, HTML meta refresh), plus .htaccess, nginx, and robots.txt rules. CSV import of slug/affiliate_url pairs, slug auto-generator from hostname, click-tracking parameter builder, URL-shortener compatibility check, history (localStorage), shareable URL. 100% client-side.
Anchor Text Distribution Analyzer
Analyze anchor text distribution from backlink data. Categorize anchors as exact/partial match, branded, generic, naked URL, or image. Compute distribution %, warn on over-optimization, and export. 100% client-side.