Module1- Big Data

Domain Modeling

  • Definition: A domain model represents objects and the relationships between them.

  • Importance of detail level in modeling for clarity and utility.

System Intuition

  • Dual Processes:

    • System 1: Fast, automatic, associative, instinctual, requires less cognitive effort.

    • System 2: Slow, rational, logical, and requires more deliberate thought.

  • Source: Daniel Kahneman.

Stakeholders in Education Supply Chain

  • Students in need of credentials.

  • Schools with accreditation.

  • Components of education system: teach classes, rent housing, enroll students, assign faculty, build facilities, confer degrees, graduate school admissions, program development, faculty research, calendar management.

Evolution of Containerization

  • Prior to Containerization: Goods were loaded onto vessels individually; high labor costs and risks of loss limited shipping options.

  • Revolution in a Box:

    • In 1956, Malcolm McLean developed the modern shipping container.

    • Initial voyage transported 58 boxes; innovation emphasized efficiency in goods movement.

    • Design shared for free to enhance logistical processes.

MASS CARGO

  • Example: MSC OSCAR—the largest modern container ship holding 20,000 boxes.

History of Shipping Containerization

  • Consolidation of shipping interests; standard container sizes developed through negotiation.

  • Containerization facilitates viable global trade.

Twist Lock Technology

  • Standardized corner of containers called a Twist Lock, leading to uniformity in shipping container design.

  • Open-source concept akin to software solutions, improving logistical integration and reducing competition.

Digital Ecosystem & Containerization

  • Bin Packing: Digital solutions for packing logistics in shipping.

  • Steering: Requires sophisticated digital management systems to handle vast data flows, enhancing voyage value.

  • Port Management: New systems evolved for managing box transit and storage, replacing paper documentation with digital standards.

Definition of a Computer

  • Components discussed:

    • Data Repository: Structured storage of information.

    • Storage: Persistent information retrieval capabilities.

    • Network: Data transmission using protocols.

    • Compute: Manipulating information reliably.

Technological Advancements

  • Dramatic reduction in technology costs since the 1960s to 2020.

  • Notable price changes in compute, storage, and connectivity over time (PwC/Strategy& analysis).

Data Volume Insights

  • Anticipated data creation reaching 64.2 zettabytes in 2020, increasing to 180 zettabytes by 2025.

  • Only 2% of data from 2020 retained into 2021.

  • Installed storage base reached 6.7 zettabytes in 2020.

Hype Cycle for Data Management (2022)

  • Trends in data management include:

    • Distributed Transactional Databases

    • DataOps

    • Augmented Data Quality

    • Cloud Data Ecosystems

  • Time to plateau for various technologies varies from <2 years to >10 years.

Understanding the Cloud

  • Components of the Cloud:

    • Distributed Storage: Always accessible files.

    • Software Defined Networks: Machines connected through configuration.

    • Parallel Compute: Utilizes multiple processors simultaneously.

Significance of the Cloud

  1. Reflects the most significant shift in computing since PCs.

  2. Key to understanding emerging technologies.

  3. Essential for powering supply chains.

Cloud Service Models

  • IaaS (Infrastructure as a Service): Utilize external hardware.

  • PaaS (Platform as a Service): Leverage external best practices.

  • SaaS (Software as a Service): Use external software solutions.

Example of Cloud Model with Pizza

  • Comparative Analysis:

    • On-premises as a traditional kitchen vs. as a service model.

    • Different responsibilities depicted through analogies of pizza-making processes.

Reflection Exercise

  • Identify three cloud services in personal use and their compelling aspects.

Data Storage Structure

  • A computer is composed of:

    • Storage

    • Network

    • Transformation (Compute)

  • Access methods, metadata, data logs, and methods for information communication outlined.

Aim for Unified Systems

  • Key Concept: ONE PURPOSE = ONE SYSTEM across various operational components (MRP, MES, WMS, TMS).

Overview of SAP SCM Modules

  • Highlighting strategic elements and detailed processes within the ERP system, covering:

    • Planning, sourcing, procurement, manufacturing, warehousing, logistics, and analytics.

Model to Realization

  • Concept Focus: Object Model, Product Domain, and the Technology Integration.