Uploaded image for project: 'MusicBrainz Server'
  1. MusicBrainz Server
  2. MBS-8213

Further reduce memory usage of subscription emails script

    XMLWordPrintable

    Details

    • Type: Task
    • Status: Open
    • Priority: Normal
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Scripts
    • Labels:
      None

      Description

      The subscription emails script still uses very much memory (around 5 GB). There was some discussion about possible improvements yesterday (http://chatlogs.musicbrainz.org/musicbrainz-devel/2015/2015-02/2015-02-10.html#T19-06-16-540578):

      • Process editors in smaller batches.
      • Don't load subscriptions for editors without email address, as they won't be sent an email anyway.
      • Retrieve the list of entities with more than, e.g., two subscribers from the database before the run, and only cache those.
      • Only store aggregate information about the edits (number of open ones, number of applied ones).
      • Perhaps even: Only load aggregate information from the DB to begin with.

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              chirlu Ulrich Klauer
              Reporter:
              chirlu Ulrich Klauer
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Dates

                Created:
                Updated:

                  Packages

                  Version Package