SMX Advanced: Yahoo Issues Bot-Herding Standard

by
Uncategorized
No Comment

Presented by Priyank Garg from Yahoo

Standard Across All Engines

Robots.txt

  • Disallow
  • Allow
  • Wildcard tags
  • Sitemap location

Meta Tags:

  • NoIndex
  • NoFollow
  • NoSnippet
  • NoArchive
  • NOODP

Optional Robots.Txt/MetaTags by Engine
 Yahoo

  • Crawl delay
  • NOYDIR
  • Robots-nocontent

Google

  • UNAVAILABLE AFTER
  • NOTRANSLATE
    NOIMAGEINDEX

MSN

  •     Crawl Delay
Discuss on Twitter View Discussion

Share This Story!

About Author

Helped launch Showtime Networks first website. From there to NBC’s Internet division and ran NBC.com, launching some of the first TV to Web experiences. In 2003, helped launch InsiderPages which was acquired by CitySearch in 2006. Since then, helping clients big and small with this strange thing called “SEO”.

No Comment

Comments are closed.

Copyright © Local SEO Guide. All rights reserved.
SEO Company Pleasanton CA SEO Company Pleasanton CA
“agencies brightlocal top local seo blogs 2020 winnerroam

Terms and Conditions - Privacy Policy