AI for Research Analysis: Miro & Dovetail

Approach to Using AI for Analysis

  • Humans should lead data interpretation and analysis.
  • AI features should be used as a sanity check or second pair of eyes at the end of the analysis.
  • Researchers should do their own analysis to deeply understand their data and become familiar with themes.
  • Skipping the manual analysis step results in a high-level understanding but lacks the deep understanding that human researchers provide.

Using Miro AI for Analysis

  • Miro offers various AI features, including document creation, translation, and analysis.
  • Two analysis options:
    • Cluster by keywords
    • Cluster by sentiment
      • Sentiment analysis groups notes into positive, neutral, or negative categories.
      • May be useful for identifying overlooked emotions but generally doesn't offer significant new insights.
  • Clustering by keywords groups notes based on identified keywords.
    • AI groupings aren't fully rounded themes but can highlight useful keywords.
    • Serves as a second pair of eyes, especially when working alone, to catch anything missed.

Using Dovetail for Analysis

  • Dovetail is described as an insights hub for storing user interviews, usability tests, and survey responses.
  • Offers AI-generated transcription and clustering.
  • Transcription:
    • Automatically transcribes recordings.
    • Requires manual review for accuracy.
  • AI-Generated Summary:
    • Provides a summary of main points, requiring human interpretation to ensure meaningfulness.
  • Highlights:
    • Identifies important moments in usability tests.
    • Requires cross-referencing with researcher's notes to validate importance.
  • Tags:
    • Dovetail's term for themes.
    • Users can select text and assign tags.

Dovetail Canvases

  • Dovetail's interface can be complex to navigate.
  • Canvases are available for data and highlights.
  • Highlights Canvas:
    • Users can add AI-generated highlights to the canvas.
    • The cluster button arranges highlights into groups.
      • Clustering options: by themes, by tag, or by data.
      • AI-generated themes might not always be meaningful and require human interpretation.

Dovetail AI - Upcoming Features

  • Summarized Data: AI automatically generates key summary points.
  • Highlight Key Moments: AI identifies important moments.
    • Suggestion setting prompts users to accept or reject highlights.
  • Upcoming features:
    • Auto Create Tags: AI generates themes (potential time-saver but should be used as a sanity check).
    • Redact Sensitive Information: Ability to blur out sensitive information (e.g., participant faces or personal details).
    • Creating Insights: Overarching themes across interviews and usability tests.

Conclusion

  • AI tools are a nice-to-have but not a replacement for human analysis.
  • Human interpretation should come first, with AI as a backup.