Section 1: Data Preparation and Ingestion - DEEPSEEK

Data Profiling

The process of examining data to collect statistics and information about its structure

Data Validation

Ensuring data conforms to predefined rules and constraints to maintain accuracy and consistency.

Data Transformation

Converting data from one format or structure to another (e.g.

ETL (Extract-Transform-Load)

A methodology where data is transformed before loading into a target system.

ELT (Extract-Load-Transform)

A methodology where raw data is loaded first

ETLT

A hybrid approach combining ETL and ELT for complex workflows.

Storage Transfer Service

A Google Cloud tool for transferring data from on-premises or cloud storage to Cloud Storage.

Transfer Appliance

A physical hardware device for securely transferring large offline datasets to Google Cloud.

Data Quality Assessment

Evaluating data for completeness

Cloud Data Fusion

A fully managed data integration service for building ETL/ELT pipelines.

BigQuery Data Transfer Service

Automates data imports from SaaS applications (e.g.

CSV (Comma-Separated Values)

A plain-text format for tabular data

JSON (JavaScript Object Notation)

A semi-structured format for nested or hierarchical data.

Apache Parquet

A columnar storage format optimized for analytics workloads.

Apache Avro

A row-based format supporting schema evolution and efficient serialization.

Structured Data

Data organized in predefined schemas (e.g.

Unstructured Data

Data with no predefined schema (e.g.

Semi-Structured Data

Data with partial organization (e.g.

Cloud Storage

A scalable object storage service for unstructured/semi-structured data.

BigQuery

A serverless data warehouse for structured analytics using SQL.

Cloud SQL

A managed relational database service for MySQL

Firestore

A NoSQL document database for mobile and web applications.

Bigtable

A high-performance NoSQL database for large-scale analytical workloads.

Spanner

A globally distributed relational database with horizontal scalability.

Regional Storage

Data stored in a single geographic region for low-latency access.

Dual-Regional Storage

Data replicated across two regions for higher availability.

Multi-Regional Storage

Data distributed globally across multiple regions for maximum redundancy.

Zonal Storage

Data stored in a single zone within a region (lower redundancy).

gcloud CLI

A command-line tool for interacting with Google Cloud services.

BQ CLI

A command-line interface specifically for BigQuery operations.