Announcement

Announcement Module
Collapse
No announcement yet.

Errors during node connection

Page Title Module
Move Remove Collapse
X
Conversation Detail Module
Collapse
  • Filter
  • Time
  • Show
Clear All
new posts

  • Errors during node connection

    Hello. Please help me to configure nodes.
    I'm trying to make two test nodes. OS is Ubuntu 13.10 in Virtual Box (two machines), i have installed percona-xtradb-cluster-56.
    Here is configs:
    Configs:
    node1:
    Code:
    [mysqld]
    user=mysql
    
    wsrep_provider=/usr/lib/libgalera_smm.so
    wsrep_cluster_address=gcomm://10.10.10.2,10.10.10.3
    wsrep_cluster_name=my_cluster
    wsrep_node_name=node1
    wsrep_slave_threads=2
    
    binlog_format=ROW
    default_storage_engine=InnoDB
    innodb_autoinc_lock_mode=2
    innodb_locks_unsafe_for_binlog=1
    
    pid-file = /var/run/mysqld/mysqld.pid
    socket = /var/run/mysqld/mysqld.sock
    port = 3306
    #basedir = /usr/
    #datadir = /var/lib/mysql
    datadir = /mnt/data
    tmpdir = /tmp
    log_error = /var/log/mysql/error.log
    
    expire_logs_days = 10
    max_binlog_size = 100M
    node2:
    Code:
    [mysqld]
    user=mysql
    
    wsrep_provider=/usr/lib/libgalera_smm.so
    wsrep_cluster_address=gcomm://10.10.10.2,10.10.10.3
    wsrep_cluster_name=my_cluster
    wsrep_node_name=node2
    wsrep_slave_threads=2
    
    binlog_format=ROW
    default_storage_engine=InnoDB
    innodb_autoinc_lock_mode=2
    innodb_locks_unsafe_for_binlog=1
    
    pid-file = /var/run/mysqld/mysqld.pid
    socket = /var/run/mysqld/mysqld.sock
    port = 3306
    #basedir = /usr/
    #datadir = /var/lib/mysql
    datadir = /mnt/data
    tmpdir = /tmp
    log_error = /var/log/mysql/error.log
    
    expire_logs_days = 10
    max_binlog_size = 100M
    I have executed
    Code:
    sudo /etc/init.d/apparmor teardown
    on both nodes.
    Firstly i run
    Code:
    sudo /etc/init.d/mysql bootstrap-pxc
    on the first node. Secondly
    Code:
    sudo /etc/init.d/mysql start
    on the second node and after that i get error.
    Here are last ~80 strings from /var/log/mysql/error.log from second node:
    Code:
    2014-05-03 20:09:10 6017 [Note] WSREP: Opened channel 'my_cluster'
    2014-05-03 20:09:10 6017 [Note] WSREP: Waiting for SST to complete.
    2014-05-03 20:09:10 6017 [Note] WSREP: New COMPONENT: primary = no, bootstrap = no, my_idx = 0, memb_num = 1
    2014-05-03 20:09:10 6017 [Note] WSREP: Flow-control interval: [16, 16]
    2014-05-03 20:09:10 6017 [Note] WSREP: Received NON-PRIMARY.
    2014-05-03 20:09:10 6017 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2
    2014-05-03 20:09:10 6017 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
    2014-05-03 20:09:10 6017 [Note] WSREP: STATE EXCHANGE: sent state msg: 408ac5af-d2dd-11e3-82f1-522a1f7ceae1
    2014-05-03 20:09:10 6017 [Note] WSREP: STATE EXCHANGE: got state msg: 408ac5af-d2dd-11e3-82f1-522a1f7ceae1 from 0 (node1)
    2014-05-03 20:09:10 6017 [Note] WSREP: New cluster view: global state: :-1, view# -1: non-Primary, number of nodes: 1, my index: 0, protocol version -1
    2014-05-03 20:09:10 6017 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
    2014-05-03 20:09:10 6017 [Note] WSREP: STATE EXCHANGE: got state msg: 408ac5af-d2dd-11e3-82f1-522a1f7ceae1 from 1 (node2)
    2014-05-03 20:09:10 6017 [Note] WSREP: Quorum results:
        version    = 3,
        component  = PRIMARY,
        conf_id    = 9,
        members    = 1/2 (joined/total),
        act_id     = 0,
        last_appl. = -1,
        protocols  = 0/5/2 (gcs/repl/appl),
        group UUID = 24b28f33-d2d8-11e3-bc16-83e9e87ba4d9
    2014-05-03 20:09:10 6017 [Note] WSREP: Flow-control interval: [23, 23]
    2014-05-03 20:09:10 6017 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 0)
    2014-05-03 20:09:10 6017 [Note] WSREP: State transfer required:
        Group state: 24b28f33-d2d8-11e3-bc16-83e9e87ba4d9:0
        Local state: 00000000-0000-0000-0000-000000000000:-1
    2014-05-03 20:09:10 6017 [Note] WSREP: New cluster view: global state: 24b28f33-d2d8-11e3-bc16-83e9e87ba4d9:0, view# 10: Primary, number of nodes: 2, my index: 1, protocol version 2
    2014-05-03 20:09:10 6017 [Warning] WSREP: Gap in state sequence. Need state transfer.
    2014-05-03 20:09:12 6017 [ERROR] WSREP: Node IP address not obtained from bind_address, trying alternate methods
    2014-05-03 20:09:12 6017 [Note] WSREP: Running: 'wsrep_sst_xtrabackup-v2 --role 'joiner' --address '10.10.10.3' --auth '' --datadir '/mnt/data/' --defaults-file '/etc/mysql/my.cnf' --parent '6017'  '' '
    WSREP_SST: [INFO] Streaming with xbstream (20140503 20:09:12.557)
    WSREP_SST: [INFO] Using socat as streamer (20140503 20:09:12.559)
    WSREP_SST: [INFO] Evaluating timeout -k 110 100 socat -u TCP-LISTEN:4444,reuseaddr stdio | xbstream -x; RC=( ${PIPESTATUS[@]} ) (20140503 20:09:12.760)
    2014-05-03 20:09:12 6017 [Note] WSREP: Prepared SST request: xtrabackup-v2|10.10.10.3:4444/xtrabackup_sst
    2014-05-03 20:09:12 6017 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
    2014-05-03 20:09:12 6017 [Note] WSREP: REPL Protocols: 5 (3, 1)
    2014-05-03 20:09:12 6017 [Note] WSREP: Service thread queue flushed.
    2014-05-03 20:09:12 6017 [Note] WSREP: Assign initial position for certification: 0, protocol version: 3
    2014-05-03 20:09:12 6017 [Note] WSREP: Service thread queue flushed.
    2014-05-03 20:09:12 6017 [Warning] WSREP: Failed to prepare for incremental state transfer: Local state UUID (00000000-0000-0000-0000-000000000000) does not match group state UUID (24b28f33-d2d8-11e3-bc16-83e9e87ba4d9): 1 (Operation not permitted)
         at galera/src/replicator_str.cpp:prepare_for_IST():447. IST will be unavailable.
    2014-05-03 20:09:12 6017 [Note] WSREP: Member 1.0 (node2) requested state transfer from '*any*'. Selected 0.0 (node1)(SYNCED) as donor.
    2014-05-03 20:09:12 6017 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 0)
    2014-05-03 20:09:12 6017 [Note] WSREP: Requesting state transfer: success, donor: 0
    WSREP_SST: [INFO] Proceeding with SST (20140503 20:09:13.425)
    WSREP_SST: [INFO] Cleaning the existing datadir (20140503 20:09:13.429)
    <deleting files>
    WSREP_SST: [INFO] Evaluating socat -u TCP-LISTEN:4444,reuseaddr stdio | xbstream -x; RC=( ${PIPESTATUS[@]} ) (20140503 20:09:13.454)
    WSREP_SST: [ERROR] xtrabackup process ended without creating '/mnt/data//xtrabackup_galera_info' (20140503 20:09:23.598)
    WSREP_SST: [INFO] Contents of datadir (20140503 20:09:23.601)
    2014-05-03 20:09:23 6017 [Warning] WSREP: 0.0 (node1): State transfer to 1.0 (node2) failed: -22 (Invalid argument)
    2014-05-03 20:09:23 6017 [ERROR] WSREP: gcs/src/gcs_group.c:gcs_group_handle_join_msg():723: Will never receive state. Need to abort.
    2014-05-03 20:09:23 6017 [Note] WSREP: gcomm: terminating thread
    2014-05-03 20:09:23 6017 [Note] WSREP: gcomm: joining thread
    2014-05-03 20:09:23 6017 [Note] WSREP: gcomm: closing backend
    WSREP_SST: [INFO] -rw------- 1 mysql mysql 134219048 мая    3 20:09 /mnt/data//galera.cache
    -rw-rw---- 1 mysql mysql       104 мая    3 20:09 /mnt/data//grastate.dat
    -rw-rw---- 1 mysql mysql         0 мая    3 20:09 /mnt/data//sst_in_progress (20140503 20:09:23.609)
    WSREP_SST: [ERROR] Cleanup after exit with status:32 (20140503 20:09:23.623)
    WSREP_SST: [INFO] Removing the sst_in_progress file (20140503 20:09:23.632)
    2014-05-03 20:09:23 6017 [ERROR] WSREP: Process completed with error: wsrep_sst_xtrabackup-v2 --role 'joiner' --address '10.10.10.3' --auth '' --datadir '/mnt/data/' --defaults-file '/etc/mysql/my.cnf' --parent '6017'  '' : 32 (Broken pipe)
    2014-05-03 20:09:23 6017 [ERROR] WSREP: Failed to read uuid:seqno from joiner script.
    2014-05-03 20:09:23 6017 [ERROR] WSREP: SST failed: 32 (Broken pipe)
    2014-05-03 20:09:23 6017 [ERROR] Aborting
    
    2014-05-03 20:09:24 6017 [Note] WSREP: view(view_id(NON_PRIM,23586eaf-d2dd-11e3-9689-4a288117eae0,11) memb {
        3ebce417-d2dd-11e3-b92f-23953b84f844,0
    } joined {
    } left {
    } partitioned {
        23586eaf-d2dd-11e3-9689-4a288117eae0,0
    })
    2014-05-03 20:09:24 6017 [Note] WSREP: view((empty))
    2014-05-03 20:09:24 6017 [Note] WSREP: gcomm: closed
    2014-05-03 20:09:24 6017 [Note] WSREP: /usr/sbin/mysqld: Terminated.
    Aborted (core dumped)
    140503 20:09:24 mysqld_safe mysqld from pid file /var/run/mysqld/mysqld.pid ended
    Also I even can't connect to the first node from the second (mysql -h 10.10.10.2 -u root tell me something like "Host 10.10.10.3 is not allowed to connect to this MySQL server". bind-address 0.0.0.0 does not help).
    Last edited by Tokew; 05-03-2014, 11:55 AM.

  • #2
    Sorry, i should have written auth information into config and have granted permissions to user in the first node.

    Comment


    • #3
      Paste the full innobackup.backup.log from node1 here.
      Basically, you need to specify http://www.percona.com/doc/percona-x...wsrep_sst_auth on donor node.

      Comment

      Working...
      X