Provide the 'return_url' in the allocate slots view
This url can then be used to post and receive JSON data from.
Patch by: Sverre Rabbelier
# Directions for web crawlers.# See http://www.robotstxt.org/wc/norobots.html.User-agent: HTTrackUser-agent: pufUser-agent: MSIECrawlerUser-agent: NutchDisallow: /