# robots.txt for threeriverspublishing.com User-agent: Slurp Disallow: / # Allow only major search spiders User-agent: * Crawl-delay: 10 User-agent: Mediapartners-Google Disallow: User-agent: Googlebot Disallow: User-agent: Adsbot-Google Disallow: User-agent: Googlebot-Image Disallow: User-agent: Googlebot-Mobile Disallow: User-agent: MSNBot Disallow: User-agent: bingbot Disallow: # Block all other spiders User-agent: * Disallow: / # Blocks Directories for all bots User-agent: * Disallow: /cgi-bin/ Disallow: /pdf/ Disallow: /Scripts/ Disallow: /wantads/ Disallow: /TRP3/administrator/ Disallow: /TRP3/bin/ Disallow: /TRP3/cache/ Disallow: /TRP3/cli/ Disallow: /TRP3/components/ Disallow: /TRP3/docs/ Disallow: /TRP3/images/ Disallow: /TRP3/images_bak/ Disallow: /TRP3/includes/ Disallow: /TRP3/jaextmanager_data/ Disallow: /TRP3/installation/ Disallow: /TRP3/language/ Disallow: /TRP3/layouts/ Disallow: /TRP3/libraries/ Disallow: /TRP3/logs/ Disallow: /TRP3/media/ Disallow: /TRP3/modules/ Disallow: /TRP3/plugins/ Disallow: /TRP3/templates/ Disallow: /TRP3/tmp/ Disallow: /joomla310/ Disallow: /TRP4/