Mercurial Mercurial > py_tasks_melange / annotate
summary | shortlog | changelog | graph | tags | bookmarks | branches | files | changeset | file | latest | revisions | annotate | diff | comparison | raw | help
Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
app/django/core/handlers/profiler-hotshot.py
author Madhusudan C.S <madhusudancs@gmail.com>
Sat, 25 Jul 2009 01:09:46 +0530
changeset 2679 0ede2f3adbc1
parent 54 03e267d67478
permissions -rw-r--r--
Adds to Melange a tags framework based on taggable-mixin. The taggable-mixin allowed only tag per Datastore model. This is extended framework allows any arbitrary number of tags per Datastore model. Also, now one can define different models for different Tag types which are all inherited from the base Tag model provided by taggable-mixin. The GHOPTask model makes use of 2 tags per model, one for difficulty and the other for task_type, both using the tags framework. Reviewed by: Paweł Sołyga
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
54
03e267d67478 Major reorganization of the soc svn repo, to merge into a single App Engine
Todd Larsen <tlarsen@google.com>
parents:
diff changeset 
     1
 
import hotshot, time, os
03e267d67478 Major reorganization of the soc svn repo, to merge into a single App Engine
Todd Larsen <tlarsen@google.com>
parents:
diff changeset 
     2
 
from django.core.handlers.modpython import ModPythonHandler
03e267d67478 Major reorganization of the soc svn repo, to merge into a single App Engine
Todd Larsen <tlarsen@google.com>
parents:
diff changeset 
     3
 












03e267d67478
Major reorganization of the soc svn repo, to merge into a single App Engine



Todd Larsen <tlarsen@google.com>


parents: 

diff
changeset




     4


PROFILE_DATA_DIR = "/var/log/cmsprofile"













03e267d67478
Major reorganization of the soc svn repo, to merge into a single App Engine



Todd Larsen <tlarsen@google.com>


parents: 

diff
changeset




     5














03e267d67478
Major reorganization of the soc svn repo, to merge into a single App Engine



Todd Larsen <tlarsen@google.com>


parents: 

diff
changeset




     6


def handler(req):













03e267d67478
Major reorganization of the soc svn repo, to merge into a single App Engine



Todd Larsen <tlarsen@google.com>


parents: 

diff
changeset




     7


    '''













03e267d67478
Major reorganization of the soc svn repo, to merge into a single App Engine



Todd Larsen <tlarsen@google.com>


parents: 

diff
changeset




     8


    Handler that uses hotshot to store profile data.













03e267d67478
Major reorganization of the soc svn repo, to merge into a single App Engine



Todd Larsen <tlarsen@google.com>


parents: 

diff
changeset




     9














03e267d67478
Major reorganization of the soc svn repo, to merge into a single App Engine



Todd Larsen <tlarsen@google.com>


parents: 

diff
changeset




    10


    Stores profile data in PROFILE_DATA_DIR.  Since hotshot has no way (that I













03e267d67478
Major reorganization of the soc svn repo, to merge into a single App Engine



Todd Larsen <tlarsen@google.com>


parents: 

diff
changeset




    11


    know of) to append profile data to a single file, each request gets its own













03e267d67478
Major reorganization of the soc svn repo, to merge into a single App Engine



Todd Larsen <tlarsen@google.com>


parents: 

diff
changeset




    12


    profile.  The file names are in the format <url>.<n>.prof where <url> is













03e267d67478
Major reorganization of the soc svn repo, to merge into a single App Engine



Todd Larsen <tlarsen@google.com>


parents: 

diff
changeset




    13


    the request path with "/" replaced by ".", and <n> is a timestamp with













03e267d67478
Major reorganization of the soc svn repo, to merge into a single App Engine



Todd Larsen <tlarsen@google.com>


parents: 

diff
changeset




    14


    microseconds to prevent overwriting files.













03e267d67478
Major reorganization of the soc svn repo, to merge into a single App Engine



Todd Larsen <tlarsen@google.com>


parents: 

diff
changeset




    15














03e267d67478
Major reorganization of the soc svn repo, to merge into a single App Engine



Todd Larsen <tlarsen@google.com>


parents: 

diff
changeset




    16


    Use the gather_profile_stats.py script to gather these individual request













03e267d67478
Major reorganization of the soc svn repo, to merge into a single App Engine



Todd Larsen <tlarsen@google.com>


parents: 

diff
changeset




    17


    profiles into aggregated profiles by request path.













03e267d67478
Major reorganization of the soc svn repo, to merge into a single App Engine



Todd Larsen <tlarsen@google.com>


parents: 

diff
changeset




    18


    '''













03e267d67478
Major reorganization of the soc svn repo, to merge into a single App Engine



Todd Larsen <tlarsen@google.com>


parents: 

diff
changeset




    19


    profname = "%s.%.3f.prof" % (req.uri.strip("/").replace('/', '.'), time.time())













03e267d67478
Major reorganization of the soc svn repo, to merge into a single App Engine



Todd Larsen <tlarsen@google.com>


parents: 

diff
changeset




    20


    profname = os.path.join(PROFILE_DATA_DIR, profname)













03e267d67478
Major reorganization of the soc svn repo, to merge into a single App Engine



Todd Larsen <tlarsen@google.com>


parents: 

diff
changeset




    21


    prof = hotshot.Profile(profname)













03e267d67478
Major reorganization of the soc svn repo, to merge into a single App Engine



Todd Larsen <tlarsen@google.com>


parents: 

diff
changeset




    22


    return prof.runcall(ModPythonHandler(), req)















py_tasks_melange