Exploring Data Transformation - GCP

GCP Core Storage

Cloud Storage, Cloud SQL, Cloud Spanner, Big Query, Fire Store and Cloud Bigtable.

What type of storage is Cloud Storage?

Object Storage

Four Primary Storage Classes

standard storage, nearline storage,

standard storage

frequently accessed hot data (AWS S3 standard)

Nearline storage

infrequently accessed data, like reading or modifying data on average once a month or less. (AWS S3 - infrequent access)

Coldline Storage

for data that needs to be accessed every 90 days. (AWS - S3 Glacier Instant Retrieval)

Archive Storage

This is the lowest cost option used, ideally, for data archiving, online backup, and disaster recovery. minimum storage 365 days. (AWS - S3 Deep Glacier

All storage have ________ encrypted by default.

data at rest

Structured data

consists of numbers and values that are organized in a predefined format that's easily searchable in a relational database.

Cloud SQL doesn’t require…

any software installation or maintenance

Cloud Spanner

fully managed, mission, critical relational database service that scales horizontally to handle unexpected business spikes.

Cloud SQL and Cloud Spanner are fully managed database services, but how do they differ?

BigQuery

fully managed data warehouse.

BigQuery provides two services in one

storage and analytics.

two semi structured data storage products

Firestore and Cloud Bigtable

Firestore

flexible, horizontally scalable NoSQL Cloud database for storing and syncing data in real time.

Cloud Bigtable

low-latency NoSQL, big data database service. (powers analytics, search and gmail)

data is transactional and you need to access it by…

SQL, then Cloud SQL and Cloud Spanner are two options.

If you have analytical workloads that require SQL commands…

BigQuery might be the best option.

ETL

extract, transform and load

What Google Cloud business intelligence platform is designed to help individuals and teams analyze, visualize, and share data?

Looker