Ntu general real-time synchronization system, hereinafter referred to as: GBase RTSync, it is an independent research and development of heterogeneous and homogeneous incremental database data real-time synchronization products, have real-time, consistency, precision, easy extensibility and integration features, apply to OLTP database and linkage to the OLAP database application system to provide the data management and data analysis function of the business scenario, can realize real-time data synchronization OLTP database to OLAP database, so as to make the OLAP database with the foundation of real-time data analysis, solve the problem of incremental data synchronization, can effectively improve data warehouse system, BI system efficiency and timeliness of data analysis and decision support system,

Key technology GBase RTSync
- based on logical log analytical incremental effect on source-sink small
- online, to reduce unplanned downtime of source-sink
- support distributed architecture for extending
- compatible with mainstream message middleware Kafka, the rabbitMQ
- to support high availability mode

Project requirements
Some provinces to focus its personnel, financial, material, client, assets, projects such as 10 business subject domain implementation model of data integration, data integration involving 3000 + a physical model, has 3000 + zhang involves the source table, etc., the project model, table, table relationships complexity is high, but it requires the data integration work fast, accurate incremental data quasi real-time synchronization to the data warehouse,

Project plan
GBase RTSync + GBase 8 a MPP combination, build GBase RTSync front-facing server, docking front-end source and history and back-end whole domain model of the data layer and mild summary details, RTSync complete historical data import and source-sink zero downtime of incremental data access, support peak source library 1.5 TB/day archive of incremental synchronization, GBase RTSync + GBase 8 a MPP cluster database depth optimal binding, satisfy the mass data storage, massively parallel computing, quasi real-time transfers of incremental functional requirements and performance requirements, such as

The project value
This project adopts the GBase 8 a MPP large-scale distributed parallel database cluster system, set up 14 node cluster (5 + 9 data cluster node) detailed data and mild summary data storage consolidation,

+ quasi real-time, accurate and efficient: GBase RTSync realize incremental extraction, the incremental load of quasi real-time data synchronization function, the synchronization efficiency up to second level; And ensure synchronous data;
+ huge amounts of data, the initialization, realize high speed data loading and storage of providing high compression ratio so as to improve performance at the same time, mass storage capacity, integrated business data, and according to the demand for online dynamic extension;
+ full quantity initialization, without stopping: new business table access its whole business does not need to stop the source end of the unified data center database, also do not need to suspend the original business running, GBase RTSync to realize the seamless combination of historical data and incremental data under the protection of the normal running of source-sink, efficient load to the integration of database,