For help, the problem of a python form transformation-CodePudding

There are two forms, how to put above the table into the table below, hundreds of thousands of quantity of the data, thank you for help

CodePudding user response:

At first sight feeling with several cycles to achieve function, but hundreds of thousands of data each loop execution of flowers, can very card, slowly? Looking forward to the old method of drivers

CodePudding user response:

reference 1st floor nangongxiaobai response:

the first feeling with several cycles to achieve function, but hundreds of thousands of data each loop execution of flowers, can very card, slowly? Looking forward to the old method of drivers

I want to own is stored separately with the dictionary brand and product, and then added to the back, that must be very slow, so, want to have a better method

CodePudding user response:

Think of a way to, to come, have a good hope to have more communication!
Python turn after grouping transverse longitudinal data - https://blog.csdn.net/weixin_45611266/article/details/103056151

CodePudding user response:

The

reference 4 floor Guest Sir. 'response:

think of a way to, to come, good hope to have more communication!
Python turn after grouping transverse longitudinal data - https://blog.csdn.net/weixin_45611266/article/details/103056151

This method also seemed almost, also not much, still accounts for a large number of memory, only numpy use c storage efficiency high than a dictionary

CodePudding user response:

Processing algorithm is the same, using multithreading is going to handle the data into multiple parallel processing

CodePudding user response:

reference 5 floor JMZL reply:

Quote: refer to 4th floor Guest Sir. 'response:
think of a way to, to come, have a good hope to have more communication!
Python turn after grouping transverse longitudinal data - https://blog.csdn.net/weixin_45611266/article/details/103056151

This method also seemed almost, also not much, still accounts for a large number of memory, only numpy use c storage efficiency high than a dictionary

well, c is at the bottom of the better ways to do

CodePudding user response:

reference 5 floor JMZL reply:

Quote: refer to 4th floor Guest Sir. 'response:
think of a way to, to come, have a good hope to have more communication!
Python turn after grouping transverse longitudinal data - https://blog.csdn.net/weixin_45611266/article/details/103056151

This method also seemed almost, also not much, still accounts for a large number of memory, only numpy use c storage efficiency high than a dictionary

no, I just want to consider only under the condition of modified algorithm, how to improve the speed, multiple threads, it is not an aspect

CodePudding user response:

Numpy + multithreading