Foundations of Data Lecture Notes
Foundations of Data
- Lecture Objectives:
- Define key concepts such as data, data analysis, and data ecosystems.
- Discuss the use of data in everyday decisions and organizational decision-making.
- Explain data as an asset and its governance.
- Distinguish Business Data Analytics from Data Analytics/Science.
- Develop a Business Canvas for analysis preparation.
Understanding Data
- Organizations require data analysts to improve processes, identify opportunities, launch products, provide customer service, and make decisions.
- Data is simply a collection of facts.
- Through analysis, data evolves over time, providing new insights throughout its lifecycle.
Data Analysis
- Involves collection, transformation, and organization of data to draw conclusions and drive decision-making.
- Insights from analysis are communicated for informed action in organizations.
- Data analysts play roles such as explorer, detective, and artist in their work.
Key Skills for Data Analysts
- Curiosity: Desire to learn and tackle challenges.
- Understanding Context: Listening and grasping the bigger picture.
- Technical Mindset: Ability to break issues down logically.
- Data Design: Organizing information effectively.
- Data Strategy: Managing tools, processes, and people in data analysis.
Analytical Thinking Steps
- Visualization: Graphical representation of data.
- Strategy: Define objectives for analysis.
- Problem Orientation: Identification and solving of issues.
- Correlation: Recognizing relationships between data points.
- Big Picture and Detail Orientation: Balancing overall strategy with details.
Analytical Tools
- Spreadsheets: Organize and visualize data (e.g. Excel, Google Sheets).
- Functions include collecting, storing, organizing, sorting, and pattern identification.
- Databases and SQL: Structured collections of data, isolating information through query languages (e.g. SELECT, FROM, WHERE).
- Visualization Tools: Convert complexity into understandable formats (e.g. Tableau, Looker).
Nature of Data
- Data is a collection of facts representing information (numerical or non-numerical) about various aspects, such as customers and products.
- Requires context, often documented as metadata, to be meaningful.
Data Management
- Encompasses plans and practices for effective data usage throughout its lifecycle.
- Core activities include understanding data origins, usage, and organization goals.
- Requires balancing strategic and operational needs.
Data Quality
- Ensuring data meets expected quality standards (accuracy, completeness, timeliness, validity, consistency).
- Involves defining standards, measuring data quality, and implementing improvement processes.
Metadata Management
- Metadata describes data, providing essential context and technical details.
- Effective management improves confidence in data and operational efficiency.
Data Architecture and Modelling
- Data Architecture outlines the blueprint for data management aligned with strategic objectives.
- Involves models, definitions, and standard methodologies to support organizational data needs.
- Data modelling helps describe and communicate data requirements precisely.
Enterprise Architecture
- Frameworks like the Zachman Framework organize and define various architectural requirements including data.
- It influences the scope and project requirements aligned with governance and integration planning.
Data Ecosystem
- Refers to the elements that interact to manage and analyze data throughout its lifecycle.
- Key interactions support data creation, management, and diachronic analysis.
Data as an Asset
- Recognizes data as an economic resource that possesses value and can be utilized for multiple purposes.
- Requires effective management to safeguard and enhance its lifecycle value.
Data-Driven Decision-Making
- Business Intelligence (BI) applications assist organizations in making informed decisions by providing access to analyzed data.
- Data analysis supports various business strategies and operational functions.
Governance Frameworks
- Data Governance emphasizes planning and oversight for effective data management, aimed at maximizing value.
- Frameworks like COBIT, DGI, and the CMMI DMM Model support organizations in establishing data governance practices.
Business Data Analytics
- Involves collecting and analyzing data to inform business decisions and strategies.
- Relates closely to BI, which provides tools and technologies for data access and analysis.
Business Model Canvas
- A strategic tool to visualize and develop business strategies, enabling understanding of data needs across key business components.
- Identifies key partners, activities, resources, value propositions, customer segments, channels, and revenue streams to align business actions with BI strategies.
Final Point
- Emphasizes the essential role of data in analytics and decision-making: "Data! Data! Data!"