ISP500 Topic 3 Data and Knowledge Management_ch5

Topic 3: Data and Knowledge Management (Ch 5) ISP500 Foundation of Information Systems

Chapter Outline

  • Managing Data

  • The Database Approach

  • Big Data

  • Data Warehouses and Data Marts

  • Knowledge Management

Managing Data

  • Proper management of data transforms it into information and subsequently into knowledge.

Importance of High-Quality Data
  • IT applications rely on data that should be:

    • Accurate

    • Complete

    • Timely

    • Consistent

    • Accessible

    • Relevant

    • Concise

  • Increasing complexity in acquiring, maintaining, and managing data.

The Difficulties of Managing Data

  • Exponential Data Growth:

    • Data increases rapidly, necessitating long-term storage.

    • Large retailers (e.g., Walmart) manage petabytes of data to support extensive customer bases.

  • Data Distribution Challenges:

    • Data is scattered and collected by multiple individuals through different methods and formats.

    • Data is stored in various locations, servers, and systems.

  • Sources of Data:

    • Internal (corporate databases, company documents)

    • Personal (individual thoughts and experiences)

    • External (commercial databases, government reports, web sources)

  • Data Degradation:

    • Change in customer details or company status (e.g., address changes, mergers).

  • Data Rot Issues:

    • Physical media deterioration over time (affecting accessibility).

    • Obsolescence of machines required for data access.

Organizational Information Systems

  • Specialized information systems for processes like:

    • Transaction processing

    • Supply chain management

    • Customer relationship management

  • Risk of data duplication and inconsistencies across different functions (e.g., marketing vs. billing).

Data Governance

  • Overview:

    • An organizational approach to manage information effectively.

    • Involves development of formal business processes and policies to handle data consistently.

  • Objectives of Data Governance:

    • Ensure data availability, transparency, and utility for authorized users.

The Database Approach

Challenges Addressed by Database Systems
  • Data Redundancy: Same data stored in multiple locations.

  • Data Isolation: Different applications unable to access shared data.

  • Data Inconsistency: Variants of data not aligning across systems.

Benefits of Database Systems
  • Data Integrity: Ensures data meets defined constraints.

  • Data Independence: Applications and data structures are separate, allowing broader data access.

Data Hierarchy

  • Organizational structure from bits to databases.

Database Management System (DBMS)

  • A suite of programs facilitating database creation and management.

  • Functions include:

    • Adding

    • Deleting

    • Accessing

    • Modifying

    • Analyzing data

Big Data

Characteristics
  • Volume: Huge amounts of data generated (e.g., sensors producing terabytes of data).

  • Velocity: Rapid data flow increases feedback speed for businesses.

  • Variety: Changes in data types (structured vs. unstructured) including diverse formats like images and social media content.

Issues with Big Data
  • Source Trustworthiness: Challenges with integrating unverified sources (e.g. social media).

  • Data Quality Issues: Dirty data (inaccuracies, duplicates) can undermine analytics.

  • Dynamic Data Conditions: Real-time data capture quality can fluctuate under varying conditions.

Data Warehouses and Data Marts

  • Data Warehouse: A comprehensive repository of historical data organized by subject, used mainly by large companies.

  • Data Mart: A cost-effective, limited version of a warehouse for specific strategic business units, quicker to implement.

Characteristics
  • Organized by business dimensions or subjects.

  • Use online analytical processing.

  • Integrated data from multiple systems around common subjects.

  • Maintain historical data that is nonvolatile and multidimensional.

Knowledge Management

  • A process for managing important unstructured knowledge within an organization’s memory.

  • Critical for knowledge to be shareable and grow within the organization.

Knowledge Management Systems (KMSs)

  • Utilize modern technologies to manage knowledge effectively among individuals.

  • Assist organizations in managing human capital and logistics during changes.

KMS Cycle Steps
  1. Create Knowledge: Innovate and develop methods.

  2. Capture Knowledge: Identify and represent valuable knowledge.

  3. Refine Knowledge: Contextualize knowledge to make it actionable.

  4. Store Knowledge: Use repositories for access.

  5. Manage Knowledge: Regular updates and verification of knowledge relevance.

  6. Disseminate Knowledge: Ensure knowledge availability in useful formats for all organizational members.