Uploaded image for project: 'Zapped: AcousticBrainz'
  1. Zapped: AcousticBrainz
  2. AB-465

similarity: Functionality to add new similarity

    • Icon: Improvement Improvement
    • Resolution: Unresolved
    • Icon: Normal Normal
    • None
    • None
    • None
    • None

      When we add items to the similarity.similarity table, we add all columns at once. If we want to add a new type of similarity that requires a new column in this table, we'll have to decide if we want to drop the table, recreate it with all columns and then re-import again, or add a new column and backfill it.

      With 24 million rows, it takes about 16 hours to create this table, so it's definitely possible to do so multiple times, but we should check if we can make it significantly faster by just adding a column. AB is currently using PG 10, so we cannot create a non-null column without locking the table. As this table is only used when rebuilding the index files this may not be a huge problem.

            Unassigned Unassigned
            alastairp Alastair Porter
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:

                Version Package