Home Page

Minneapolis Online Marketing Blog

The Minneapolis Online Marketing blog covers online marketing industry topics, news and events from all angles. This includes search engine optimization (SEO), pay-per click (PPC), email marketing, social media, online PR, web strategy, web development and more. We hope you choose to subscribe to our blog to keep you up on our latest and greatest. Please check back often and feel free to leave a comment! Thanks for reading!

Search

Search Minneapolis Online Marketing Blog!

Subscribe to the Minneapolis Online Marketing Blog!



Online Marketing Quick Tip - Search Engine Optimization - Robots.txt Files

Posted January 12th, 2009 by Mike Rynchek

Mike Rynchek
Mike Rynchek
Spyder Trap Online Marketing

Robots.txt Files

  • Tells the Search Engine what to/not to crawl (pure data)

    • - Java Files
    - Flash (swf)
    - CSS

  • Keep certain pages from showing in SERPs
  • Add to root level of site

    • - Google Webmaster account

  • Declare xml sitemap

Sample Robots.txt File

Sample Robots.txt File

Stay tuned to the Spyder Trap Online Marketing Quick Tips, as next week we will discuss xml sitemaps.

Tags: , , , ,

Filed under:Search Engine Optimization, Video Blogging

Leave a Reply