Uploaded image for project: 'MusicBrainz Server'
  1. MusicBrainz Server
  2. MBS-9342

InitDb.pl fails to import data with DBD::Pg 3.6.0

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Fixed
    • Icon: Normal Normal
    • 2017-07-17
    • None
    • None
    • None

      When downloading the following data dumps and importing them, I get several errors.

      http://ftp.musicbrainz.org/pub/musicbrainz/data/fullexport/20170515-224223/

      Command used to import was:

      ./admin/InitDb.pl --createdb --import /tmp/dumps/mbdump*.tar.bz2 --echo
      

      Errors are:

      label                             122880  99%    617499Error loading /tmp/MBImport-S07U9Qby/mbdump/label: 22001 DBD::Pg::db pg_putcopyend failed: ERROR:  value too long for type character varying(255)
      CONTEXT:  COPY label, line 102861, column comment: "מובייל1 מיוזיק היא חברה המשו?..." at /opt/mbz-slave/admin/MBImport.pl line 324, <LOAD> line 123942.
      
      annotation                        483328  99%    285463Error loading /tmp/MBImport-q5tGDV0U/mbdump/annotation: 22001 DBD::Pg::db pg_putcopyend failed: ERROR:  value too long for type character varying(255)
      CONTEXT:  COPY annotation, line 37294, column changelog: "Name used up to 1997/08/25: 松澤由実  Name used after 1997/08/25: 松澤由..." at /opt/mbz-slave/admin/MBImport.pl line 324, <LOAD> line 484162.
      
      tag                                69632  98%   1399694Error loading /tmp/MBImport-q5tGDV0U/mbdump/tag: 22001 DBD::Pg::db pg_putcopyend failed: ERROR:  value too long for type character varying(255)
      CONTEXT:  COPY tag, line 39663, column name: ""プラスチックのcd箱(2枚)について、..." at /opt/mbz-slave/admin/MBImport.pl line 324, <LOAD> line 70854.
      
      Tue May 16 15:46:54 2017 : import finished
      Loaded 237 tables (117291525 rows) in 1343 seconds
      
      Failed to import dataset.
      Tue May 16 15:46:55 2017 : InitDb.pl failed
      

       

      Postgres version is 9.5

      $ psql musicbrainz_db -c 'SHOW SERVER_ENCODING'
      Password for user musicbrainz: 
       server_encoding 
      -----------------
       UTF8
      (1 row)
      
      $ psql musicbrainz_db -c 'SHOW CLIENT_ENCODING'
      Password for user musicbrainz: 
       client_encoding 
      -----------------
       UTF8
      (1 row)
      
      musicbrainz_db=> SELECT pg_encoding_to_char(encoding) FROM pg_database WHERE datname = 'musicbrainz_db';
       pg_encoding_to_char 
      ---------------------
       UTF8
      (1 row)
      
      musicbrainz_db=> \d+ label
                                                              Table "musicbrainz.label"
            Column      |           Type           |                     Modifiers                      | Storage  | Stats target | Description 
      ------------------+--------------------------+----------------------------------------------------+----------+--------------+-------------
       id               | integer                  | not null default nextval('label_id_seq'::regclass) | plain    |              | 
       gid              | uuid                     | not null                                           | plain    |              | 
       name             | character varying        | not null                                           | extended |              | 
       begin_date_year  | smallint                 |                                                    | plain    |              | 
       begin_date_month | smallint                 |                                                    | plain    |              | 
       begin_date_day   | smallint                 |                                                    | plain    |              | 
       end_date_year    | smallint                 |                                                    | plain    |              | 
       end_date_month   | smallint                 |                                                    | plain    |              | 
       end_date_day     | smallint                 |                                                    | plain    |              | 
       label_code       | integer                  |                                                    | plain    |              | 
       type             | integer                  |                                                    | plain    |              | 
       area             | integer                  |                                                    | plain    |              | 
       comment          | character varying(255)   | not null default ''::character varying             | extended |              | 
       edits_pending    | integer                  | not null default 0                                 | plain    |              | 
       last_updated     | timestamp with time zone | default now()                                      | plain    |              | 
       ended            | boolean                  | not null default false                             | plain    |              | 
      Check constraints:
          "label_edits_pending_check" CHECK (edits_pending >= 0)
          "label_ended_check" CHECK ((end_date_year IS NOT NULL OR end_date_month IS NOT NULL OR end_date_day IS NOT NULL) AND ended = true OR end_date_year IS NULL AND end_date_month IS NULL AND end_date_day IS NULL)
          "label_label_code_check" CHECK (label_code > 0 AND label_code < 100000)
      

            bitmap Michael Wiencek
            mglubb Matthew Glubb
            Votes:
            1 Vote for this issue
            Watchers:
            4 Start watching this issue

              Created:
              Updated:
              Resolved:

                Version Package
                2017-07-17