BUS intelligence

ETL

Extract, transform, load, used when extracting uncleaned data

Staging area

temporary storage for data before cleaning

Data cleaning methods

• handling missing values

• removing duplicates

• data standardization

• correcting inconsistent values

• outlier detection

• data type conversion

• data validation

Data lake

large storage for raw data, all type of data, in its original frm

Data warehouse

Storage for structured data to support decision making.

• subject oriented

• from different sources

• maintains historical data, time is a dimension

• nonvolatile (data does not change after being entered)

Business Intelligence

Umbrella term combinging architectures, tools, databases, analytical tools, applications and methodologies

OLTP

Systems built to handle day to day processes ued by company

• sales

• transfers

• messages

OLAP

Systems built to handle analytical and business intelligence tasks

Why companies use OLAP

• Large Volume Data

• Historical agreggated data

• multidimensional or relational databases

• Large Storage requirements

• longer response times

• good for analzying trends

OLTP

• manage real-time transaction

• real time transactional data

• uses RDB