Skip to content
Book a demoStart free

Noindex & Nofollow Checker

Check meta robots directives, X-Robots-Tag headers, and robots.txt rules affecting indexing and crawling.

Noindex & Nofollow CheckerGratisOn-Page SEOChecks a live URL

Enter a public URL. We fetch the live page and analyse what search engines and AI crawlers see.

Key features of the noindex and nofollow checker

  • Reads both meta robots tag and X-Robots-Tag HTTP header
  • Displays all robot directives: index/noindex, follow/nofollow, noarchive, nosnippet
  • Clearly flags pages that are blocked from indexing
  • Checks for conflicts between directives
  • Supports all major robot directives including googlebot-specific ones

How to use the noindex and nofollow checker

  1. Enter the URL

    Paste the full URL of the page you want to check into the input field.

  2. Run the check

    Click 'Check Robots Directives' to fetch the page and read its meta and HTTP header directives.

  3. Review indexing status

    See whether the page is set to index or noindex, and follow or nofollow.

  4. Check for unintended directives

    Look for noindex on pages that should be indexed — these are lost from Google search.

  5. Remove or correct directives

    Update your CMS, theme settings, or page headers to fix any unintended robot directives.

What is a noindex and nofollow checker?

The Noindex/Nofollow Checker reads the meta robots tag and X-Robots-Tag HTTP header of any webpage to determine its crawling and indexing directives. It tells you whether a page is set to noindex (excluded from search engines), nofollow (links not followed), or other robot instructions like noarchive, nosnippet, and more.

Accidentally publishing pages with a noindex tag is one of the most costly SEO mistakes — your content simply won't appear in Google search results. This tool gives you instant visibility into a page's indexation status so you can quickly identify and fix misconfigured robot directives.

Why use a noindex and nofollow checker?

A single forgotten noindex tag from development can keep an entire section of your site out of Google's index. This tool is your first line of defence against indexation errors — especially after migrations, theme changes, or CMS updates where noindex settings can be unintentionally applied site-wide.

Noindex and nofollow checker: frequently asked questions

Something else? Ask the team

What does noindex mean?

Noindex is a robot directive that tells search engines not to include the page in their search index. Pages with noindex will not appear in Google search results.

What does nofollow mean in meta robots?

Nofollow in the meta robots tag tells search engine crawlers not to follow any links on that page. It's different from the rel='nofollow' attribute on individual links.

Where can robots directives be set?

Robot directives can be set in two places: the HTML meta robots tag (<meta name='robots' content='noindex'>) in the page head, or the X-Robots-Tag HTTP response header. Both are equally respected by Google.

Can a page be indexed if robots.txt blocks it?

Robots.txt blocks crawling but doesn't guarantee deindexing. If a page is blocked in robots.txt but has no noindex tag, Google may still index it based on links from other pages.

Is nofollow in meta robots the same as link-level nofollow?

No. Page-level nofollow (in meta robots) affects all links on the page. Link-level nofollow (rel='nofollow') applies only to that specific link. The page-level directive is much more restrictive.

Each one opens on its own page and works straight away, with no sign-up.

Ontdek meer gratis tools:Schema GeneratorMetatag GeneratorLLMs.txt GeneratorBrowse all free tools

Meer AI-vermeldingen winnen?

Noindex & Nofollow Checker is one piece of the puzzle. See how ChatGPT, Gemini, Perplexity, and Google AI Overviews actually view your brand, and get a prioritised list of fixes, with a free AEO & GEO audit from AI Rank Lab.

One check is a start. The audit checks the whole site.

Voer een gratis AEO- en GEO-audit uit or Bekijk prijzen.

  • Scores SEO, answer-engine (AEO) and generative-engine (GEO) readiness
  • Lists the fixes, page by page
  • Then track whether ChatGPT, Gemini, Perplexity and Google AI Overviews cite you
fieldnote.app4,571 credits

Site audit

fieldnote.app · SEO, AEO and GEO

Illustrative data
SEO
82
+6
AEO
64
+11
GEO
58
+9
Pages
48
Fixesby impact
  • /pricing · Missing H1High
  • /blog/guide · No FAQ schemaMedium
  • /llms.txt · Not foundMedium
  • /about · Meta description too longLow

See where your whole site stands

Paste your site. The free audit scores it for SEO, answer engines and generative engines, with the fixes.

Start freeBook a demo