The composition of the data warehouse system
Bottom: data warehouse server
The middle layer: the OLAP server
Top: the front-end tool
Data sources: data files, database,
Operation - the data extraction, cleaning, transformation, loading
Stored in a data warehouse after DW,
OLAP: it performs some AI algorithm, according to the different problems related data extracted from the data warehouse,
The front-end tool: visual interface, is more vivid and interactive,
On-line analytical processing (OLAP) - the main battlefield of artificial intelligence, have the enormous data support of data warehouse, and online learning AI system,
5. The steps to establish data warehouse
- determine the analysis of business requirements
- data analysis model is established and the physical design of data warehouse
- determine for the analysis of the data source
- select a data warehouse platform (database system, on-line analytical processing (OLAP) tools, OLTP tools, development tools, data display tools)
- cluster data source database extract, purify and transform data into data warehouse, data loading, data cleaning)
- according to the theme for data analysis
- update database,
6. The data mining technology
Basic concepts - 1
The current situation of information system in information
- data too much, too little information, or data explosion but poor knowledge,
- hard to find the potential rules and relation between data,
To interaction analysis, understand all kinds of combination meaning,
- hard to trace history data (data islands)
- as the amount of data increases, the difficulty of data is more and more big...
But messy information there are a lot of valuable information
Example: the story of diapers and beer,
Epidemic and hospitals, to cope with the