Mercurial Mercurial > py_tasks_melange / annotate
summary | shortlog | changelog | graph | tags | bookmarks | branches | files | changeset | file | latest | revisions | annotate | diff | comparison | raw | help
Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
app/django/core/handlers/profiler-hotshot.py
author Daniel Bentley <dbentley@google.com>
Sun, 12 Apr 2009 09:06:45 +0000
branchgae-fetch-limitation-fix
changeset 2313 c39a81bce1bd
parent 54 03e267d67478
permissions -rw-r--r--
Use offset_linkid instead of offset to scan >1000 entities. this is a first-cut. It works in all the ways I could make earlier versions fail. It passes link_id as URL parameters. It also has a new class LinkCreator which makes the main body of getListContents even easier to write. I wasn't sure if link_id's could have non alphanumeric characters; if so, they need to be URL encoded/decoded. I also need to go and remove any mention of raw offsets now, because we don't use them. I believe I've talked about this approach with a few of you and it sounded reasonable. Feel free to roll-back/fix/amend/comment-for-me-to-fix. This is my first big-logic-change to Melange. Patch by: Dan Bentley
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
54
03e267d67478 Major reorganization of the soc svn repo, to merge into a single App Engine
Todd Larsen <tlarsen@google.com>
parents:
diff changeset 
     1
 
import hotshot, time, os
03e267d67478 Major reorganization of the soc svn repo, to merge into a single App Engine
Todd Larsen <tlarsen@google.com>
parents:
diff changeset 
     2
 
from django.core.handlers.modpython import ModPythonHandler
03e267d67478 Major reorganization of the soc svn repo, to merge into a single App Engine
Todd Larsen <tlarsen@google.com>
parents:
diff changeset 
     3
 












03e267d67478
Major reorganization of the soc svn repo, to merge into a single App Engine



Todd Larsen <tlarsen@google.com>


parents: 

diff
changeset




     4


PROFILE_DATA_DIR = "/var/log/cmsprofile"













03e267d67478
Major reorganization of the soc svn repo, to merge into a single App Engine



Todd Larsen <tlarsen@google.com>


parents: 

diff
changeset




     5














03e267d67478
Major reorganization of the soc svn repo, to merge into a single App Engine



Todd Larsen <tlarsen@google.com>


parents: 

diff
changeset




     6


def handler(req):













03e267d67478
Major reorganization of the soc svn repo, to merge into a single App Engine



Todd Larsen <tlarsen@google.com>


parents: 

diff
changeset




     7


    '''













03e267d67478
Major reorganization of the soc svn repo, to merge into a single App Engine



Todd Larsen <tlarsen@google.com>


parents: 

diff
changeset




     8


    Handler that uses hotshot to store profile data.













03e267d67478
Major reorganization of the soc svn repo, to merge into a single App Engine



Todd Larsen <tlarsen@google.com>


parents: 

diff
changeset




     9














03e267d67478
Major reorganization of the soc svn repo, to merge into a single App Engine



Todd Larsen <tlarsen@google.com>


parents: 

diff
changeset




    10


    Stores profile data in PROFILE_DATA_DIR.  Since hotshot has no way (that I













03e267d67478
Major reorganization of the soc svn repo, to merge into a single App Engine



Todd Larsen <tlarsen@google.com>


parents: 

diff
changeset




    11


    know of) to append profile data to a single file, each request gets its own













03e267d67478
Major reorganization of the soc svn repo, to merge into a single App Engine



Todd Larsen <tlarsen@google.com>


parents: 

diff
changeset




    12


    profile.  The file names are in the format <url>.<n>.prof where <url> is













03e267d67478
Major reorganization of the soc svn repo, to merge into a single App Engine



Todd Larsen <tlarsen@google.com>


parents: 

diff
changeset




    13


    the request path with "/" replaced by ".", and <n> is a timestamp with













03e267d67478
Major reorganization of the soc svn repo, to merge into a single App Engine



Todd Larsen <tlarsen@google.com>


parents: 

diff
changeset




    14


    microseconds to prevent overwriting files.













03e267d67478
Major reorganization of the soc svn repo, to merge into a single App Engine



Todd Larsen <tlarsen@google.com>


parents: 

diff
changeset




    15














03e267d67478
Major reorganization of the soc svn repo, to merge into a single App Engine



Todd Larsen <tlarsen@google.com>


parents: 

diff
changeset




    16


    Use the gather_profile_stats.py script to gather these individual request













03e267d67478
Major reorganization of the soc svn repo, to merge into a single App Engine



Todd Larsen <tlarsen@google.com>


parents: 

diff
changeset




    17


    profiles into aggregated profiles by request path.













03e267d67478
Major reorganization of the soc svn repo, to merge into a single App Engine



Todd Larsen <tlarsen@google.com>


parents: 

diff
changeset




    18


    '''













03e267d67478
Major reorganization of the soc svn repo, to merge into a single App Engine



Todd Larsen <tlarsen@google.com>


parents: 

diff
changeset




    19


    profname = "%s.%.3f.prof" % (req.uri.strip("/").replace('/', '.'), time.time())













03e267d67478
Major reorganization of the soc svn repo, to merge into a single App Engine



Todd Larsen <tlarsen@google.com>


parents: 

diff
changeset




    20


    profname = os.path.join(PROFILE_DATA_DIR, profname)













03e267d67478
Major reorganization of the soc svn repo, to merge into a single App Engine



Todd Larsen <tlarsen@google.com>


parents: 

diff
changeset




    21


    prof = hotshot.Profile(profname)













03e267d67478
Major reorganization of the soc svn repo, to merge into a single App Engine



Todd Larsen <tlarsen@google.com>


parents: 

diff
changeset




    22


    return prof.runcall(ModPythonHandler(), req)















py_tasks_melange