Home > database >  Mysql library data summary
Mysql library data summary

Time:10-04

Probably is such, because business need database have done a master-slave library has 3 sets of identical database load the same in different areas of the business,
Example:
A regional access A_DB library
B area access B_DB library
C region access C_DB library
A_DB B_DB C_DB data structure exactly just because the different service area of the data content.

Now you need to the three rolls of data transfer in accordance with the previous data structure summary together! Do the data analysis and report query, don't know what method can achieve!
Ways to eliminate yourself interface

Mysql with multi-source replication, but multi-source copy only A_DB B_DB C_DB synchronization to an instance or three libraries, if really can't meet the needs of our extensible!

Don't know whether there are other solutions!

CodePudding user response:

Mysqlbinlog parsed into SQL execution in the specified library?

CodePudding user response:

reference 1st floor pansiliang2009 response:
mysqlbinlog parsed into SQL execution in the specified library?

Can you give us some details?

CodePudding user response:

If really can't meet the needs of our extensible!

Extensible requirements?

Actually do statements, use mysql is not very suitable, mysql is not suitable for used to do data analysis, report query, of course, if just copied from other database, the data that to also can, but a large amount of data, there must be a big problem,

You have database summary of three areas into an instance, actual a long would certainly have performance issues, I think if I can in this way, or your original plan, put the data in an instance of three libraries,

Then, on a server, the data of the three libraries, extract to a library, a list a table contains three areas of data, so convenient summary, do the table at the same time, according to the requirements of your business analysis, determine the time dimension, divided into different tables, reduce the data storage for each table,

As for analysis, finally is to do the etl, data warehouse is simply data balance, summary,

CodePudding user response:

In addition, the data extraction to come over on a table, the table need to increase the field, can increase a regional field, if combined the original primary key id, do a new master key, both meaning, also can do data only,

CodePudding user response:

With the kettle come together, and extract data can be processed
  • Related