Skip to content
Gravity Search Marketing
  • Why Gravity
  • Services
  • Blog
  • Contact Us

How to Use the Robots Meta Tag

  • February 20, 2008
  • by Gradiva Couzin

The Robots meta tag has been around for ages, but some new features introduced in 2006 and 2007 have made it a lot more useful than it used to be. Here’s the 4-1-1.

Robots meta tag basics

The robots meta tag is a part of a web page that communicates information to search engine robots. The robots meta tag is written within the <head> of an HTML file and looks something like this:

<meta name=”robots” content=”noindex, nofollow, noodp, noydir, nosnippet”>

Here is what you can put inside the “content” area:

  • “noindex”– this will prevent search engines from indexing the page
  • “nofollow” — this will prevent search engines from following any link on the page
  • “noarchive” — this will prevent search engines from keeping a cached version of the page in search results
  • “nosnippet” — this will prevent a description from appearing on your site’s listing on search engine results pages
  • “noodp” — this will prevent search engines from displaying the Open Directory title or description on your site’s listing
  • “noydir” — this will prevent Yahoo! from displaying the Yahoo! Directory title or description on your sites listing
  • “none” – this is the equivalent of “noindex, nofollow”
  • “noimageindex” – this will prevent search engines from indexing images on the page

Excluding a page from indexing with NOINDEX

To exclude a page from indexing, use the following format: <meta name=”robots” content=”noindex”> .

This type of exclusion is an alternative to excluding with the robots.txt file. Differences between the two methods of exclusion can be seen in the following table: (note, this table applies to Google only).

Table: Google Robots Exclusion with the Robots Meta Tag

Feature Robots.txt exclusion Robots meta tag exclusion
Page accumulates PageRank? yes yes
Page listed in Google? the URL may be displayed in listings no
Page passes PageRank through outbound links? no yes!

Improving Search Engine Listings with NOODP and NOYDIR

Some websites are saddled with outdated titles and descriptions from the Yahoo! Directory or the Open Directory. This is a very simple problem to solve, using the “noodp” and “noydir” meta tags. These tags will prevent the directory titles and descriptions from displaying for your site. Instead, your own HTML titles will display, along with snippets that are generated from your page content (or, sometimes, your Meta Descripton tag).

Share this:

  • Click to share on Twitter (Opens in new window)
  • Click to share on Facebook (Opens in new window)

Related

Ask the Experts: Should I Make My Website With Site Build It (or siteCube, Web.com, etc.)?
Ask the Experts: How Do I Manually Ping Google Blog Search?
6 COMMENTS
  • Tammy-website help
    August 9, 2010 at 2:39 pm

    This has been a great article to read. I linked it to my meta-tag page within my website: http://helpwithyourwebsite.com/MetaTagsRobot.aspx

    Thanks very much for your meta-tag tips!

  • y
    December 2, 2010 at 1:09 am

    Thank you, the original book written together with the description of this page, it is really more

  • [edited - please use a name, not a keyword]
    August 14, 2011 at 3:43 pm

    I had no idea NOODP and NOYDIR existed as robot tags, thanks for the tips 🙂

  • Sasikumar
    April 28, 2012 at 9:58 am

    Simple but informative article. I’m certainly bookmarking this page.
    Good that I bought the book SEO-An Hour A Day. I am able to dive deeper into SEO practices now.

    K.P. Sasikumar
    Sabre Marketing Services Pvt Ltd
    A Bangalore-based Lead Generation & Creative Agency

  • pedro cardona
    March 19, 2013 at 10:20 pm

    I got the book at same time i was building my web with not exact idea of what seo was.
    Thanks to you i,ve learned a lot in a very easy way

    Kind regards

  • Sarah
    April 19, 2013 at 11:50 am

    Hmm, i didn’t know both “noodp” and “noydir” prevent the directory titles and descriptions. Will give it a try now.

Comments are closed.

Who We Are
Gravity Search Marketing was formed in 2006 as a partnership between Jennifer Grappone and Gradiva Couzin. Gravity’s clients include Fortune 500 companies, global entertainment brands, niche B2Bs, large and small retailers, and non-profits.
As SEO industry veterans, Couzin and Grappone co-wrote Search Engine Optimization: An Hour a Day (Wiley, 2006, 2008, 2011) and Five Stars: Putting Online Reviews to Work for Your Business (Wiley, 2014), and enjoy sharing their expertise in speaking engagements and press interviews. 
Gravity's small, talented team has expertise in analytics, paid search, social media and technical SEO. Gravity team members are located throughout California, in Los Angeles, Sacramento, and the San Francisco Bay Area.

Get in Touch

Get An Effective SEO Strategy

Most of our business comes through word of mouth from happy customers. We work with clients who have what it takes to make the project a success: intelligence, openness to new ideas, a commitment to communicating with us regularly, and a workflow that allows us to work with you effectively.

Contact Us
  • Home
  • Why Gravity is Different
  • Services
  • Blog
  • Books We’ve Written
  • Contact Us

Women-Owned Small Business (WOSB)

Gravity is an SBA-Certified WOSB

NAICS Codes:

  • 541613 Marketing Consulting Services
  • 541810 Advertising Agencies
  • 541820 Public relations agencies
  • 541990 Other Professional Services
  • 611430 Professional and Management Training
Gravity Search Marketing LLC - A Full-Service SEO Company
Los Angeles • San Francisco
Copyright © 2020 All Rights Reserved
Theme by Colorlib Powered by WordPress