xtrabackup SST error

  • Filter
  • Time
  • Show
Clear All
new posts

  • xtrabackup SST error


    I'm trying the Percona XtraDB Cluster for testing purpose. I've used the wsrep_sst_method with rsync and mysqldump options, and works correctly.

    The problem comes when I want to try the xtrabackup method for avoid the blocking tables problem. I don't know why, but the node can't go up, it shows me a failed message. The mysql error log shows the next output:

    130307 16:09:09 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 0)130307 16:09:09 [Note] WSREP: State transfer required: Group state: f3200c7c-8737-11e2-0800-b41de5c8e559:0 Local state: 514091b6-8722-11e2-0800-b5722dd612ea:0130307 16:09:09 [Note] WSREP: New cluster view: global state: f3200c7c-8737-11e2-0800-b41de5c8e559:0, view# 6: Primary, number of nodes: 2, my index: 1, protocol version 2130307 16:09:09 [Warning] WSREP: Gap in state sequence. Need state transfer.130307 16:09:11 [Note] WSREP: Running: 'wsrep_sst_xtrabackup --role 'joiner' --address '' --auth 'root:XXXX' --datadir '/var/lib/mysql/' --defaults-file '/etc/mysql/my.cnf' --parent '2978''130307 16:09:11 [Note] WSREP: Prepared SST request: xtrabackup| 16:09:11 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.130307 16:09:11 [Note] WSREP: Assign initial position for certification: 0, protocol version: 2130307 16:09:11 [Warning] WSREP: Failed to prepare for incremental state transfer: Local state UUID (514091b6-8722-11e2-0800-b5722dd612ea) does not match group state UUID (f3200c7c-8737-11e2-0800-b41de5c8e559): 1 (Operation not permitted) at galera/src/replicator_str.cpprepare_for_IST():442. IST will be unavailable.130307 16:09:11 [Note] WSREP: Node 1 (ip-192-168-8-62) requested state transfer from '*any*'. Selected 0 (ip-192-168-8-38)(SYNCED) as donor.130307 16:09:11 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 0)130307 16:09:11 [Note] WSREP: Requesting state transfer: success, donor: 0tar: Saltando a la siguiente cabeceratar: Exiting with failure status due to previous errorsWSREP_SST: [ERROR] Error while getting st data from donor node: 0, 2 (20130307 16:09:20.072)130307 16:09:20 [ERROR] WSREP: Process completed with error: wsrep_sst_xtrabackup --role 'joiner' --address '' --auth 'root:XXXX' --datadir '/var/lib/mysql/' --defaults-file '/etc/mysql/my.cnf' --parent '2978': 32 (Broken pipe)130307 16:09:20 [ERROR] WSREP: Failed to read uuid:seqno from joiner script.130307 16:09:20 [ERROR] WSREP: SST failed: 32 (Broken pipe)130307 16:09:20 [ERROR] Aborting130307 16:09:20 [Warning] WSREP: 0 (ip-192-168-8-38): State transfer to 1 (ip-192-168-8-62) failed: -1 (Operation not permitted)130307 16:09:20 [ERROR] WSREP: gcs/src/gcs_group.c:gcs_group_handle_join_msg():719: Will never receive state. Need to abort.

    It shows a problem with tar program and SST failed. I've defined the wsrep_sst_method as xtrabackup and wsrep_sst_auth as root:XXXX.

    I don't know which is the problem? Anyone can help me?


  • #2
    right to check my.cnf


    • #3
      This is my my.cnf:

      [mysqld]server_id=1binlog_format=ROWlog_bin=mysql-binwsrep_cluster_address=gcomm://,, er=/usr/lib/libgalera_smm.sowsrep_cluster_name=xtradbClusterTe stwsrep_sst_method=xtrabackupwsrep_sst_auth=root:X XXXwsrep_node_name=ip-192-168-8-38

      I put the wsrep_sst_auth for authenticate the user correctly but it doesn't work.

      Any idea?


      • #4
        what file permissions my.cnf? what owner + group name?


        • #5
          The permissions are not the problem (root:root 644). It works fine if I use rsync method. I think the problem could be with the xtrabackup method.


          • #6
            I ran into a similar if not the same problem. Have a look at error log on donor. What I found was

            130312 14:36:04 [Note] WSREP: Running: 'wsrep_sst_xtrabackup --role 'donor' --address '' --auth '(null)' --socket '/var/lib/mysql/activities/mysql.sock' --datadir '/var/lib/mysql/activities/' --defaults-file '/var/lib/mysql/activities/my.activities.cnf' --gtid 'e27f0040-8641-11e2-0800-89777b386ece:276''130312 14:36:04 [Note] WSREP: sst_donor_thread signaled with 0WSREP_SST: [ERROR] innobackupex finished with error: 9. Check /var/lib/mysql/activities//innobackup.backup.log (20130312 14:36:07.102)

            "--auth '(null)'" is strange; I have set up wsrep_sst_auth. And in innobackup.backup.log I could see Xtrabackup being denied access as mysql@localhost, which is NOT what my wsrep_sst_auth contains. As a workaround to get things going for now I just granted all to mysql@localhost.

            Hope this helps.



            • #7
              In my case, I had to change sst method to rsync from xtradbackup-v2


              • #8
                Yes, try wsrep_sst_method=xtrabackup-v2