Home > Back-end >  Help solve the efficient reading, and writing XLSX issue
Help solve the efficient reading, and writing XLSX issue

Time:09-15

There may be millions of article need to deal with the data, the current reading what I use is TXLSReadWriteII5, but write XLS efficiency is too low,
Behind the use of the Internet BIFF8 binary stream write XLS format specification, weakness is no more than 65535, and write files will always prompt data may be lost, in addition to the.xls files by binary stream to write, and then use TXLSReadWriteII5 read will collapse directly, it can't find a good solution -,
Please have greatly recommend a relatively high efficiency and stable read-write XLSX document control (more than 65535 data), or write XLSX can achieve binary stream

CodePudding user response:

Supplement: don't consider using ADO, COM

CodePudding user response:

Data volume is too big, XLS each sheet maximum 1 million line, or to the paging,
Don't know such a large amount of data, running in the XLS?

CodePudding user response:

Data is stored separately in dozens of XLSX list, each table has more than 10, two hundred thousand data

CodePudding user response:

With what all won't solve your problem, you need to use VBA to connect the external database mySQL or sqlite, let EXCEL distribution points to import the data you need, but not all the data fully,

CodePudding user response:

Mars
reference 4th floor response:
with what all won't solve your problem, you need to use VBA to connect the external database mySQL or sqlite, let EXCEL distribution points to import the data you need, but not all data, all

My task is broken down to one dozen two hundred thousand data for data of XLSX file, then generate new XLSX, is not to say that the one-time need to handle millions of data

CodePudding user response:

We advise EjunDataGrid, this is domestic controls, fast,

CodePudding user response:

Why don't you consider using ADO, COM? Can consider COM copy + paste mode

CodePudding user response:

CodePudding user response:

refer to 6th floor lyhoo163 response:
we advise EjunDataGrid, it is domestic control, fast,

CodePudding user response:

May ExpressSpreadSheet more appropriate, as for speed how, see your coding way,
Feature, Maximum limit
The Open workbooks Limited by the available memory and system resources
Worksheet size Number of rows and columns is limited by the available memory and system resources. The When exporting to Microsoft Excel? The maximum number of columns is 16384, the maximum number of rows is 1048576.
The Column width 255 characters
The Row height 409 points
The Length of the cell contents (text) Limited by the available memory and system resources
Sheets in the workbook a Limited by the available memory (the default is 3 Sheets).
Colors in a workbook 16 m letters Colors (32 bit with full access to 24 bit color spectrum)
Cell styles in a workbook 64000
The Custom number formats Between 200 and 250, depending on the language version
Linked sheets Limited by the available memory
The Custom functions provides Limited by the available memory

CodePudding user response:

Millions of data? Data volume is not much,
To consider, from the perspective of hardware to multicore processors, there are 12 or 8 kernel CPU
From a software point of view, there are millions of data, do not represent each run are used for millions of software, can consider points department time processing more than batch processing, no matter what, are intended to ensure that the data are loaded as needed to ensure the least, in the case of memory is enough, to read the data in the memory,
  • Related