Meta robots tag generator
Choose whether a page should appear in search results, whether its links are followed and how much of it can be shown as a snippet. Get the meta robots tag and the X-Robots-Tag header, with warnings for settings that don't do what you expect.
How to use the Meta Robots Tag Generator
- 1Choose whether the page should be indexed and whether its links should be followed.
- 2Pick a crawler if the rule is only for Google or Bing.
- 3Add snippet, image preview and removal-date rules if you need them.
- 4Copy the meta tag into the page's head, or the header into your server config for PDFs and images.
Frequently asked questions
What is the difference between noindex and blocking a page in robots.txt?
noindex lets search engines crawl the page but tells them not to show it. robots.txt stops crawling, so a blocked page's noindex tag is never seen and the URL can still appear in results. To remove a page, use noindex and leave it crawlable.
When should I use the X-Robots-Tag header instead of a meta tag?
For files that have no HTML head, such as PDFs, images and videos, or when you want to set rules for many pages at once in your server config.
What does max-image-preview:large do?
It allows Google to show large image previews from your page in search and Discover. Google Discover needs it for big image cards, so most publishers set it.
Does nosnippet keep my content out of AI Overviews?
Google says nosnippet stops text from the page being shown as a snippet, including in AI Overviews. It also removes your normal search snippet, so use it only where you really need it.
Related free tools
All toolsThen schedule it with Join Postly
Plan, publish and track your posts on every network from one calendar. Free plan, no credit card.