Add priority groups (model, logic, and view) Priority groups will be a key part of the Job system, allowing the site admin to give a higher priority to certain job types on the fly. Patch by: Sverre Rabbelier

# Directions for web crawlers.
# See http://www.robotstxt.org/wc/norobots.html.

User-agent: HTTrack
User-agent: puf
User-agent: MSIECrawler
User-agent: Nutch
Disallow: /