To navicat import CSV file tips out of 360 million in the memory, for the great spirit-CodePudding

As title, baidu modified max_allowed_packet to 400 m

CodePudding user response:

The CSV file is divided into several, then import,

CodePudding user response:

reference 1st floor datafansbj response:

the CSV file is divided into several, then import,

It's lost the advantage of database processing large data

CodePudding user response:

refer to the second floor Nicepop response:

Quote: refer to 1st floor datafansbj response:
the CSV file is divided into several, then import,

It will lose the advantage of database processing large data

Big data processing is also have certain limit, can not be infinite, assuming that the 360 MB of data split into 10 portions, batch processing, import link won't spend more time,

CodePudding user response:

reference datafansbj reply: 3/f

Quote: refer to the second floor Nicepop response:

Quote: refer to 1st floor datafansbj response:
the CSV file is divided into several, then import,

It will lose the advantage of database processing large data

Big data processing is also have certain limit, can not be infinite, assuming that the 360 MB of data split into 10 portions, batch processing, import link won't spend more time,

others can import 10 G, I 360 guide, I good hard ah, ha ha