Meta robots tag
We check the <meta name="robots" content="noindex"> tag and bot-specific directives such as googlebot and bingbot.
Paste a URL. We'll check the page for noindex directives and tell you whether search engines are being instructed not to index it.
Test with:
We inspect the server response and returned HTML for the indexing signals that matter.
We check the <meta name="robots" content="noindex"> tag and bot-specific directives such as googlebot and bingbot.
We check the X-Robots-Tag HTTP response header. It can control indexing for HTML, PDFs, images and other resources.
We follow redirects to the final URL and check its canonical URL to show whether the preferred URL differs.
Important: we check the HTML and HTTP response returned by the server. A noindex directive added dynamically by JavaScript is not detected.
A simple six-step check gives you the important technical SEO signals.
Paste the webpage URL you want to inspect.
The checker requests the page and reads the HTTP response and HTML.
We look for noindex in robots meta tags and X-Robots-Tag headers.
If the URL redirects, we inspect the final destination.
We identify the page's declared canonical URL and compare it with the final URL.
The result explains which indexing signal was found.
Common directives the checker can identify.
<meta name="robots" content="noindex"><meta name="googlebot" content="noindex"><meta name="robots" content="noindex, nofollow">X-Robots-Tag: noindex<meta name="robots" content="none">Answers to common indexing and noindex questions.
A noindex directive tells search engines not to include a page, image, PDF, or other supported resource in their search results.
Enter the page URL into the checker. It examines the returned HTML for robots directives and the HTTP response for an X-Robots-Tag directive.
No. robots.txt controls crawling and is not a reliable way to prevent a URL from appearing in Google Search.
Find whether it comes from a robots meta tag, X-Robots-Tag header, CMS setting, SEO plugin, or server configuration, then remove or change the unintended directive.
X-Robots-Tag is an HTTP response header that gives search engines indexing and serving instructions. It is especially useful for PDFs and images.
It tells search engines not to show the page in search results and not to follow links on the page.
Google may still have the previous information until it crawls the page again. Check both HTML and HTTP response and make sure robots.txt is not blocking Googlebot.
none is equivalent to noindex, nofollow.
Yes. A canonical is a signal for the preferred version of a URL, but it is not the same as noindex.
Yes, but the checker reads the HTML and HTTP response returned by the server, so a directive added later by JavaScript is not detected.