ISP500 Topic 3 Data and Knowledge Management_ch5
Topic 3: Data and Knowledge Management (Ch 5) ISP500 Foundation of Information Systems
Chapter Outline
Managing Data
The Database Approach
Big Data
Data Warehouses and Data Marts
Knowledge Management
Managing Data
Proper management of data transforms it into information and subsequently into knowledge.
Importance of High-Quality Data
IT applications rely on data that should be:
Accurate
Complete
Timely
Consistent
Accessible
Relevant
Concise
Increasing complexity in acquiring, maintaining, and managing data.
The Difficulties of Managing Data
Exponential Data Growth:
Data increases rapidly, necessitating long-term storage.
Large retailers (e.g., Walmart) manage petabytes of data to support extensive customer bases.
Data Distribution Challenges:
Data is scattered and collected by multiple individuals through different methods and formats.
Data is stored in various locations, servers, and systems.
Sources of Data:
Internal (corporate databases, company documents)
Personal (individual thoughts and experiences)
External (commercial databases, government reports, web sources)
Data Degradation:
Change in customer details or company status (e.g., address changes, mergers).
Data Rot Issues:
Physical media deterioration over time (affecting accessibility).
Obsolescence of machines required for data access.
Organizational Information Systems
Specialized information systems for processes like:
Transaction processing
Supply chain management
Customer relationship management
Risk of data duplication and inconsistencies across different functions (e.g., marketing vs. billing).
Data Governance
Overview:
An organizational approach to manage information effectively.
Involves development of formal business processes and policies to handle data consistently.
Objectives of Data Governance:
Ensure data availability, transparency, and utility for authorized users.
The Database Approach
Challenges Addressed by Database Systems
Data Redundancy: Same data stored in multiple locations.
Data Isolation: Different applications unable to access shared data.
Data Inconsistency: Variants of data not aligning across systems.
Benefits of Database Systems
Data Integrity: Ensures data meets defined constraints.
Data Independence: Applications and data structures are separate, allowing broader data access.
Data Hierarchy
Organizational structure from bits to databases.
Database Management System (DBMS)
A suite of programs facilitating database creation and management.
Functions include:
Adding
Deleting
Accessing
Modifying
Analyzing data
Big Data
Characteristics
Volume: Huge amounts of data generated (e.g., sensors producing terabytes of data).
Velocity: Rapid data flow increases feedback speed for businesses.
Variety: Changes in data types (structured vs. unstructured) including diverse formats like images and social media content.
Issues with Big Data
Source Trustworthiness: Challenges with integrating unverified sources (e.g. social media).
Data Quality Issues: Dirty data (inaccuracies, duplicates) can undermine analytics.
Dynamic Data Conditions: Real-time data capture quality can fluctuate under varying conditions.
Data Warehouses and Data Marts
Data Warehouse: A comprehensive repository of historical data organized by subject, used mainly by large companies.
Data Mart: A cost-effective, limited version of a warehouse for specific strategic business units, quicker to implement.
Characteristics
Organized by business dimensions or subjects.
Use online analytical processing.
Integrated data from multiple systems around common subjects.
Maintain historical data that is nonvolatile and multidimensional.
Knowledge Management
A process for managing important unstructured knowledge within an organization’s memory.
Critical for knowledge to be shareable and grow within the organization.
Knowledge Management Systems (KMSs)
Utilize modern technologies to manage knowledge effectively among individuals.
Assist organizations in managing human capital and logistics during changes.
KMS Cycle Steps
Create Knowledge: Innovate and develop methods.
Capture Knowledge: Identify and represent valuable knowledge.
Refine Knowledge: Contextualize knowledge to make it actionable.
Store Knowledge: Use repositories for access.
Manage Knowledge: Regular updates and verification of knowledge relevance.
Disseminate Knowledge: Ensure knowledge availability in useful formats for all organizational members.