# Sample robots.txt file (make sure the filename is ALL LOWERCASE on Linux/Unix systems) # http://www.oscommerce.com/community/contributions,2162/ # # validators: # http://tool.motoricerca.info/robots-checker.phtml (extensive) # http://www.searchengineworld.com/cgi-bin/robotcheck.cgi (basic) # # This says to apply these settings to ALL search engine spiders/crawlers # Sitemap: http://www.beterelektro.nl/sitemapindex.xml # # These settings will keep spiders from indexing your unwanted pages # This assumes that your OSC install is in your web site's ROOT directory # ie: http://www.yoursite.com/index.php <- Use if this brings up your shop main page User-agent: * Disallow: /index.php?main_page=advanced_search Disallow: /index.php?main_page=login Disallow: /index.php?main_page=product_reviews_write Disallow: /index.php?main_page=redirect Disallow: /index.php?main_page=shopping_cart Disallow: /index.php?main_page=tell_a_friend Disallow: /index.php?main_page=create_account Disallow: /index.php?main_page=checkout_shipping Disallow: /index.php?main_page=password_forgotten #Disallow: /index.php?main_page=product_reviews Disallow: /index.php?main_page=address_book Disallow: /index.php?main_page=account_notifications Disallow: /index.php?main_page=account_password Disallow: /index.php?main_page=account Disallow: /index.php?main_page=account_edit Disallow: /index.php?main_page=account_newsletters Disallow: /index.php?main_page=cookie_usage Disallow: /index.php?main_page=contact_us