Home > Net >  How to design when importing data to determine whether there are duplicate data
How to design when importing data to determine whether there are duplicate data

Time:09-22

Consult everybody, now doing a little of HRM, the import of large amounts of data may have existing staff, how to one-time determine the import data of multiple exists in the database, which do logical judgment to the current which is prompt, and then import again, judge again, the operation is very inconvenient,

CodePudding user response:

1. The database data found out into A collection of A
2. Will import the data into a collection of B
3. O B and A set of differential C is no database data
4. Insert the C data detailed in the database

CodePudding user response:

reference 1st floor OrdinaryCoder response:
1. The database data found out into A collection of A
2. Will import the data into a collection of B
3. O B and A set of differential C is no database data
4. Insert the data in C detailed database


If there is a need to compute the result of several data table data and comparing the current import detail, how these one-time conclusion

CodePudding user response:

refer to the second floor DoulagsKor response:
Quote: refer to 1st floor OrdinaryCoder response:

1. The database data found out into A collection of A
2. Will import the data into a collection of B
3. O B and A set of differential C is no database data
4. Insert the data in C detailed database


If there is a need to compute the result of several data table data and comparing the current import detail, how these one-time conclusion

I don't know your table structure but does not need to compare the field found out and then you need to import the data and difference set

CodePudding user response:

Logically modify can!!!! Put the existence of a list, and other normal import, finally, the existing export

CodePudding user response:

Tried what you have said this way, but too slow, now there are 4 tables, each table has a 3-4 w data, in this case how to solve the speed problem commonly?

CodePudding user response:

reference 5 floor DoulagsKor reply:
tried what you have said this way, but too slow, now there are 4 tables, each table has a 3-4 w article data, in this case how to solve the speed problem commonly?

Four tables associated don't take out all the fields are only one need judgment fields such as name or something

CodePudding user response:

If only occasionally do, then completes the database index (including data structure design of inverted retrieval) is ok, it's basically metaphysical primary "query" programming problems,

But suppose consider often visit this function, practical, considering the modern big data processing system, requires the high concurrency, high performance processing technology, for example. The part that goes from the.net open source project is this kind of system,

CodePudding user response:

Based on high concurrency, cluster system, such as you can see the part that goes from the programming tutorial, without the basis of this, said the basic programming design concept instead you may wonder of the world,
  •  Tags:  
  • C#
  • Related