The list method in models/base.py can now use a filter to make a selection of entities to show.
Patch by: Lennard de Rijk
# Directions for web crawlers.# See http://www.robotstxt.org/wc/norobots.html.User-agent: HTTrackUser-agent: pufUser-agent: MSIECrawlerUser-agent: NutchDisallow: /