Module 12 - Scalability

Organization Pre-Requisites

The requirements for an organization to adopt big data, including establishing governance processes and decision frameworks to ensure responsible parties understand Big Data's implications and management requirements.

Provenance

Information about the source of the data and how it has been processed, which helps determine its authenticity, trustworthiness, and quality.

Distinct Methodology

A set of steps or a methodology to control how data flows into and out of the Big Data solutions, including establishing feedback loops for refinement.

Storage

The challenge of storing vast amounts of data, especially unstructured data that cannot be stored in traditional databases.

Processing

The difficulty in transforming, extracting, and loading raw information from various sources into a unified format for analysis.

Security

The risk of theft or damage to non-encrypted information by cyber-criminals, requiring a balance between data access and strict security protocols.

Stage 1

Business Case/Problem Definition

Stage 2

Data Identification

Stage 3

Data Acquisition and Filtration

Stage 4

Data Extraction

Stage 5

Data Validation and Cleansing

Stage 6

Data Aggregation & Representation

Stage 7

Data Analysis

Stage 8

Data Visualization

Stage 9

Utilization of Analysis Results

Data Mining

The process of searching and analyzing a large batch of raw data in order to extract useful information, identify patterns and trends, and make predictions or decisions.