Q: MySQL Cluster - Data insertion in NDBCLUSTER table - error out after 5 million rows
Posted
by
Mata
on Server Fault
See other posts from Server Fault
or by Mata
Published on 2013-11-11T09:12:09Z
Indexed on
2013/11/11
9:59 UTC
Read the original article
Hit count: 227
load
|mysql-cluster
MysqlCluster version: mysql-5.6.11 ndb-7.3.2 Insertload = 50 M dataset Datanodes = 3
LOAD DATA INFILE '/input_50m/Table_1_sorted.csv' IGNORE INTO TABLE nw_ndb FIELDS TERMINATED BY ',' LINES TERMINATED BY '\n'
We recently setup a new mySQL cluster and trying to load data from a flat file. But getting error “Got temporary error 4010 'Node failure caused abort of transaction' from NDBCLUSTER" when inserting 5 million rows in a single table in MySQL Cluster. We are using "LOAD DATA INFILE" command to load the data in the table from csv file.
Server (musqld, ndb nodes) has good hardware: 126 GB RAM, 32 Gb allocated to mysqld
tried below settings with no effect:
SET autocommit=0; SET FOREIGN_KEY_CHECKS=0; SET unique_checks=0;
SET GLOBAL ndb_batch_size=8*1024*1024;
SET GLOBAL ndb_cache_check_time = 1000;
SET GLOBAL ndb_index_stat_cache_entries = 10000000;
SET SESSION BULK_INSERT_BUFFER_SIZE=256217728;
SET GLOBAL KEY_BUFFER_SIZE=256217728;
Any clues?
© Server Fault or respective owner