CM2606: Data Engineering - Lecture 2

These flashcards cover key concepts of data modeling, AWS databases, and basic Linux commands as outlined in the lecture.

Data Modeling

The process of creating a visual representation of data elements and their relationships within a system.

Conceptual Modeling

Focuses on understanding business entities, their attributes, and relationships, independent of any specific database technology.

Logical Modeling

Translates the conceptual model into a detailed model aligned with a specific database technology, defining entities, attributes, relationships, and constraints.

Physical Modeling

Maps the logical model to the physical storage structure of the chosen database system, optimizing for performance, scalability, and security.

Entity-Relationship Diagrams (ERDs)

Visual representation of entities, attributes, and relationships; uses rectangles for entities, ovals for attributes, and diamonds for relationships.

Data Dictionary

Detailed documentation of data elements, including definitions, data types, and constraints, essential for understanding and maintaining data models.

Amazon RDS

Relational database service that supports transactional applications, ERP systems, business intelligence analytics, and mobile & gaming backends.

Amazon DynamoDB

Fully managed NoSQL database service providing fast and predictable performance with seamless scalability, ideal for high-traffic web apps and IOT devices.

Amazon ElastiCache

Fully managed in-memory caching service for fast data lookups, session storage for web applications, and real-time analytics.

Amazon Neptune

Fully managed graph database service designed for processing large sets of data, suitable for social networking, recommendation engines, and fraud detection.

Data Volume and Type

Refers to the characteristics of data being handled, such as real-time streaming data, structured data, or multimedia content.

Performance and Scalability

The ability of a database to handle continuous data updates and manage high user demand.

Availability and Reliability

Critical attributes for ensuring flight safety and passenger experience in aviation data systems.

Security and Access Control

Mechanisms to restrict unauthorized access to sensitive data in database systems.

Basic Linux commands

Command line utilities for file and directory management, such as 'ls', 'pwd', 'cd', 'touch', etc.

VIM commands

Basic commands for the VIM text editor, including opening files, entering insert mode, saving, and quitting.