Home > Back-end >  Oracle, a large amount of data read
Oracle, a large amount of data read

Time:09-21

Now doing a project need to deal with data up to about 7 million, need to download the data in Oracle to Sqlite local database for processing again, one of the fields is to save images need to extract the characteristic value of, the other fields,
Connect to the database using ODBC, due to the photo of the memory is too big, so is one-time first read id information into memory, and then open eight thread according to read one photo id card information, and then to extract the characteristic value in the sqlite, connect only once all the way, did not release resources, haven't database operation, do not understand performance, as a result, more and more slow, to more than 30000 zhang is disconnected or as the problem of error code is 10113, went to look at tomorrow,
-- -- -- -- -- the first of all, I want to ask next is done so resources are not release leads to fill every query occupancy resources, such as
I repeatedly performedChar [255] SQL={0};
Sprintf_s (SQL, "select EAZ157 from EZ16 where EAZ140='% s'", card_id);
_RecordsetPtr pRst;
PRst=ExecuteWithResSQL (SQL);
This way, what's the problem, it is pRst? Or what needed to be released
And this _RecordsetPtr just address query results first, to get his worth to the query again, or just have to read all the data in the memory, this is not clear to

As well as the question of indexed, single query a crestor is can fast a lot of the know, but for such a
Select * from test indexed and indexed have no difference between

Then is going to change into direct partitioned query processing, such as direct points and 8, 8 connections, eight thread to read, read processing directly, then can do direct deposit sqlite, (not to consider problems in deposited in the sqlite, a understand another is well done, a lot but also checked more stupid or can't do without everybody to give directions)
-- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- - a great god, and have been using qq number CSDN, today suddenly let me verify phone number, and I phone number has been changed to hurt me again registered a, no. This looks like an ocean did not -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- --