Q: MySQL Cluster - Data insertion in NDBCLUSTER table - error out after 5 million rows

Posted by Mata on Server Fault See other posts from Server Fault or by Mata
Published on 2013-11-11T09:12:09Z Indexed on 2013/11/11 9:59 UTC
Read the original article Hit count: 227

Filed under:
|

MysqlCluster version: mysql-5.6.11 ndb-7.3.2 Insertload = 50 M dataset Datanodes = 3

LOAD DATA INFILE '/input_50m/Table_1_sorted.csv' IGNORE INTO TABLE nw_ndb FIELDS TERMINATED BY ',' LINES TERMINATED BY '\n'

We recently setup a new mySQL cluster and trying to load data from a flat file. But getting error “Got temporary error 4010 'Node failure caused abort of transaction' from NDBCLUSTER" when inserting 5 million rows in a single table in MySQL Cluster. We are using "LOAD DATA INFILE" command to load the data in the table from csv file.

Server (musqld, ndb nodes) has good hardware: 126 GB RAM, 32 Gb allocated to mysqld

tried below settings with no effect:

SET autocommit=0; SET FOREIGN_KEY_CHECKS=0; SET unique_checks=0;

SET GLOBAL ndb_batch_size=8*1024*1024;

SET GLOBAL ndb_cache_check_time = 1000;

SET GLOBAL ndb_index_stat_cache_entries = 10000000;

SET SESSION BULK_INSERT_BUFFER_SIZE=256217728;

SET GLOBAL KEY_BUFFER_SIZE=256217728;

Any clues?

© Server Fault or respective owner

Related posts about load

Related posts about mysql-cluster