# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file # # To ban all spiders from the entire site uncomment the next two lines: User-Agent: * Disallow: /*report_broken_link* Disallow: /*gutschein Disallow: /?version=all Disallow: /redirect/* Disallow: /external/* Disallow: /pms/* Disallow: /session Disallow: /admin/ Disallow: /complaints/* Disallow: /favorites* Disallow: /project_logs/ Disallow: /comments/* Disallow: /redirect/* Disallow: /*thanks Disallow: /*premium_vote* Disallow: /votes* Disallow: /suche* Disallow: /login Disallow: /oauth Disallow: /modifications/*/followers Disallow: /modifications/*/videos Disallow: /mods/*/videos Disallow: /mods/*/followers Disallow: /users/*/followers