Uploaded image for project: 'ListenBrainz'
  1. ListenBrainz
  2. LB-31

Implement last import date feature

XMLWordPrintable

    • Icon: New Feature New Feature
    • Resolution: Fixed
    • Icon: Normal Normal
    • beta release
    • API
    • None

      Currently there is no way to do incremental imports. In order to support incremental imports, the scraper needs to know the last listen that was imported. To accomplish this, we need to:

      1. create a new table that tracks the user id and the last imported timestamp
      2. the cassandra writer can then update the last imported timestamp for a user at the end of a batch of imports.
      3. expose this date as a new API endpoint
      4. update the scraper to utilize this new endpoint.

            iliekcomputers Param Singh
            rob Robert Kaye
            Votes:
            1 Vote for this issue
            Watchers:
            0 Start watching this issue

              Created:
              Updated:
              Resolved:

                Version Package
                beta release