Move the hooks in base.Logic to the bottom of the class
This more closely follows 'important methods first'.
Patch by: Sverre Rabbelier
# Directions for web crawlers.# See http://www.robotstxt.org/wc/norobots.html.User-agent: HTTrackUser-agent: pufUser-agent: MSIECrawlerUser-agent: NutchDisallow: /