# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file User-Agent: * Disallow: /profile/ Disallow: /profile/* Allow: /profile/failings