4_Analysis and Visualization

Data Consumption Options

• Choosing how to consume pipeline data relies on identifying:
  • Who is consuming the data.
  • What they need to do with it.

Example User Roles and Tools

• Business Analyst:
  • Needs attractive dashboards.
  • Tool: Amazon QuickSight
    • Features:
      • Build visual dashboards from many data sources.
      • Automatically selects appropriate graph type for your data.
• Data Engineer:
  • Needs to run queries to solve problems.
  • Tool: Amazon Athena
    • Features:
      • Uses the AWS Glue data catalog.
      • Enables SQL queries against structured or unstructured data in the data lake.
    • Significance:
      • Combined with Amazon QuickSight, enables business users to create dashboards from data in the data lake.
• DevOps Engineer:
  • Needs real-time monitoring dashboards.
  • Tool: Amazon OpenSearch Service
    • Features:
      • Indexes data.
      • Supports fast searching and analysis.
      • Dashboard features to visualize real-time application events.

Primary Takeaway

• Match analysis and visualization tools to:
  • The data.
  • The use case.
  • The consumer.

Three Services to Remember

• Amazon QuickSight: For business dashboards.
• Amazon Athena: For querying data lakes.
• Amazon OpenSearch Service: For real-time search and analysis.