CR

4_Analysis and Visualization

Data Consumption Options

  • Choosing how to consume pipeline data relies on identifying:
    • Who is consuming the data.
    • What they need to do with it.

Example User Roles and Tools

  • Business Analyst:
    • Needs attractive dashboards.
    • Tool: Amazon QuickSight
      • Features:
        • Build visual dashboards from many data sources.
        • Automatically selects appropriate graph type for your data.
  • Data Engineer:
    • Needs to run queries to solve problems.
    • Tool: Amazon Athena
      • Features:
        • Uses the AWS Glue data catalog.
        • Enables SQL queries against structured or unstructured data in the data lake.
      • Significance:
        • Combined with Amazon QuickSight, enables business users to create dashboards from data in the data lake.
  • DevOps Engineer:
    • Needs real-time monitoring dashboards.
    • Tool: Amazon OpenSearch Service
      • Features:
        • Indexes data.
        • Supports fast searching and analysis.
        • Dashboard features to visualize real-time application events.

Primary Takeaway

  • Match analysis and visualization tools to:
    • The data.
    • The use case.
    • The consumer.

Three Services to Remember

  • Amazon QuickSight: For business dashboards.
  • Amazon Athena: For querying data lakes.
  • Amazon OpenSearch Service: For real-time search and analysis.