Datacentre Design , Interconnection Network & Cloud Logging

Data center

A facility made up of networked computers, storage systems, and computing infrastructure used by businesses and organizations to organize, process, and store large amounts of data.

Server

A component of a data center that consists of sockets, CPU, and internal cache, used for processing and storing data.

Data processing

The act of organizing and manipulating data within a data center for various purposes.

Storage subsystems

Components within a data center that provide storage capabilities, such as local and coherent DRAM and disk drives.

Networking switches, routers, and firewalls

Devices used in a data center to facilitate communication and secure the network.

Physical racks

Structures used to organize and interconnect IT equipment within a data center.

Cooling system

A system in a data center that regulates temperature and prevents overheating of the equipment.

Uptime guarantee

A measure of the reliability and availability of a data center, often expressed as a percentage of time that the data center is operational.

Interconnection network

The network that connects all servers within a data center cluster, enabling communication and data transfer.

Fat-tree topology

A specific type of network topology used to interconnect server nodes in a data center, providing fault tolerance and high bandwidth.

Low latency

A requirement for the interconnection network in a data center, referring to the minimal delay in transmitting data.

High bandwidth

A requirement for the interconnection network in a data center, referring to the capacity to transmit large amounts of data.

Fault tolerance

A requirement for the interconnection network in a data center, referring to the ability to continue functioning even in the presence of failures or errors.

Low cost

A requirement for the interconnection network in a data center, referring to the need for cost-effective solutions.

Message Passing Interface

A communication protocol used in parallel computing systems, often employed in data centers for efficient data transfer.

Routing protocols

Algorithms and protocols used to determine the paths and routes for data transmission within a network.

Layer 2 switch algorithm

A routing algorithm used in layer 2 switches that involves data plane flooding.

Layer 3 IP routing

A routing algorithm used in layer 3 switches that involves shortest path IP routing.

Cloud Logs

A service for storing, viewing, and interacting with logs.

Logs Explorer

A tool that allows users to search and analyze logs.

Project

A specific GCP project where logs are stored.

SHARE LINK

A feature that allows users to share a link to a specific log query.

Query

A search query used to filter and retrieve specific logs.

Recent

A section that displays recently viewed logs.

Saved

A section that displays saved log queries.

Suggested

A section that displays suggested log queries.

resource.type

A field used in log queries to specify the type of resource being logged.

Log fields

Fields that contain information about each log entry, such as severity, timestamp, and summary.

Query results

The logs that match the specified query.

SEVERITY

A field that indicates the severity level of a log entry.

TIMESTAMP

A field that indicates the timestamp of a log entry.

PDT

Pacific Daylight Time, the timezone used for log timestamps.

SUMMARY

A field that provides a summary or description of a log entry.

Showing logs for last 1 hour

The time range for which logs are displayed.

RESOURCE TYPE

A field that indicates the type of resource being logged.

Extend time by

A feature that allows users to extend the time range for log display.

Edit time

A feature that allows users to manually specify a time range for log display.

Kubernetes Container

A type of resource that can be logged.

Clear

A feature that clears the current log query and displays all logs.

x > 2021-07-01 13:41:08.028 PDT

A log filter that only displays logs with a timestamp greater than the specified time.

1bm-slis-server

A specific log entry or resource name.

request made

A log entry indicating that a request was made.

stdout

A log entry indicating standard output.

stderr

A log entry indicating standard error.

PROJECT ID

A field that indicates the ID of the GCP project being logged.

ygrinshteyn-sandbox

A specific GCP project ID.

LOCATION

A field that indicates the geographical location of the logged resource.

us-central

A specific geographical location.

CLUSTER NAME

A field that indicates the name of the cluster being logged.

prod-cluster-autopilot

A specific cluster name.

NAMESPACE NAME

A field that indicates the name of the namespace being logged.

default

A specific namespace name.

POD NAME

A field that indicates the name of the pod being logged.

1bm-slis-server request made

A log entry indicating that a request was made by the pod named "1bm-slis-server".

Cloud Logging

A service for storing, viewing, and interacting with logs in Google Cloud.

Case Study

A detailed analysis or examination of a particular subject or situation.

GCP projects

Projects created within the Google Cloud Platform.

Non-tamperable audit logs

Logs that cannot be modified or tampered with.

Logs buckets

Regional resources that store, index, and search logs.

Geographical location

The physical location where the logs infrastructure is located.

Redundantly

Ensuring that applications are available even if one zone or location fails.

Log Sources

Different types of logs that can be collected and stored.

Platform logs

Logs generated by the Google Cloud Platform services.

Custom logs

Logs generated by user software, services, or applications.

Network logs

Logs related to network activity and traffic.

Services logs

Logs generated by specific services or applications.

Agent logs

Logs generated by logging agents installed on user applications and VMs.

VPC flow logs

Logs related to Virtual Private Cloud (VPC) traffic flow.

Audit logs

Logs that provide an audit trail of administrative changes and data accesses.

API and client logs

Logs related to API calls and client interactions.

Firewall rules logs

Logs related to firewall rule activity.

NAT gateways logs

Logs related to Network Address Translation (NAT) gateways.

User apps logs

Logs generated by user applications or software.

Load Balancer logs

Logs related to load balancer activity.

Third-party applications logs

Logs generated by applications or services from third-party vendors.

System software logs

Logs related to the operating system or system-level software.

Cloud Platform Logs

Service-specific logs that help troubleshoot and debug issues in Google Cloud.

Access Transparency Logs

Logs that track actions taken by Google staff when accessing Google Cloud content.

Compliance

Ensuring adherence to legal and regulatory requirements.

Retention

The period for which logs are stored and retained.

Security Logs

Logs related to security events and activities.

Audit Logs

Logs that provide an audit trail of administrative changes and data accesses.

Admin Activity

Audit logs capturing user-initiated resource configuration changes.

Data Access

Audit logs capturing API calls that create, modify, or read user-provided data.

System Event

Audit logs capturing system-initiated resource configuration changes.

User Logs

Logs generated by user software, services, or applications.

Logging agent

An agent installed to collect logs from user applications and VMs.

Cloud Logging API

An API used to interact with Cloud Logging and retrieve logs.

Cloud Logging client libraries

Libraries that provide a programming interface for accessing Cloud Logging.

Log-based metrics

Metrics derived from log data.

Log sink

A destination for log entries.

Default log sink

The default destination for log entries.

User-created log sinks

Log sinks created by users to specify custom destinations for log entries.

Log views

Customized views of logs that allow for filtering and analysis.

Cloud Storage

A storage service provided by Google Cloud.

BigQuery

A data warehouse provided by Google Cloud.

Cloud Pub/Sub

A messaging service provided by Google Cloud.

Monitoring

The process of observing and tracking the performance and availability of resources.

Google Cloud ecosystem

The collection of services and tools provided by Google Cloud.

Third-party platforms

Platforms or services provided by third-party vendors.