Share on FacebookEmail to someoneTweet about this on TwitterGoogle+Share on LinkedInShare on Reddit

Presented by Priyank Garg from Yahoo

Standard Across All Engines

Robots.txt

  • Disallow
  • Allow
  • Wildcard tags
  • Sitemap location

Meta Tags:

  • NoIndex
  • NoFollow
  • NoSnippet
  • NoArchive
  • NOODP

Optional Robots.Txt/MetaTags by Engine
 Yahoo

  • Crawl delay
  • NOYDIR
  • Robots-nocontent

Google

  • UNAVAILABLE AFTER
  • NOTRANSLATE
    NOIMAGEINDEX

MSN

  •     Crawl Delay
 
 

No Comment

Comments are closed.