app/soc/content/robots.txt
author Madhusudan C.S <madhusudancs@gmail.com>
Sat, 22 Aug 2009 03:56:14 +0530
changeset 2783 339696f3f5cf
parent 73 211a3eeacf27
permissions -rw-r--r--
Extended program configuration create/edit views specifically to support GHOP. Added the first views for GHOP, which are inherited from soc program views. Added new param keys, module_package. url_name key now specifies this is view is from a Melange GHOP module. Also added the view to GHOP module's callback.py. The program Logic class's timeline_logic variable is tied to corresponding timeline logic within the constructor.

# Directions for web crawlers.
# See http://www.robotstxt.org/wc/norobots.html.

User-agent: HTTrack
User-agent: puf
User-agent: MSIECrawler
User-agent: Nutch
Disallow: /