Survey method of data collection (1)

Survey Method of Data Collection

• University of CUMBRIA

• Course: HRBP 5215

Uses & Advantages

• Common Method: Widely used for survey designs.

• Cost-Effective: Cheap and quick to administer, making it accessible.

• Reach: Can access large numbers of respondents across wide geographical areas.

• Bias Reduction: Standardized questions help minimize bias.

• Anonymity: Reduces bias on sensitive topics by allowing respondents to remain anonymous.

• Question Types: Can utilize both open and closed questions, with closed questions allowing for pre-coded analysis suitable for computer statistical packages.

Limitations/Disadvantages

• Accessibility Issues: Unsuitable for individuals with literacy issues, visual impairments, or non-English speakers.

• Data Depth: Data can be superficial, providing simplified results.

• Response Rates: Tends to have low response rates.

• Error Potential: Risks include response errors and incomplete answers.

• Clarification Lack: No chance to clarify misunderstandings or provide answers to questions.

• In-Depth Exploration: Lack of ability to probe further into interesting responses.

• Design Challenges: Difficult to design effective questionnaires; poorly designed instruments may not adequately address research questions.

Questionnaire Preparation

• Questions to Consider:

  • What is the aim of your research?

  • Use literature reviews to aid in topic identification.

  • Determine the number of questions needed.

  • Explore if there is an existing questionnaire available (and check permissions).

Design: Types of Questions

• Closed Questions: Respondents choose one answer (yes/no).

• Ranking Questions: Respondents order responses by preference.

• Scales: May include Likert scales or visual analogues for responses.

• List Questions: Selection from a pre-defined list.

• Categorization: Careful selection, especially regarding age (actual age vs. age group).

• Open Questions: Respondents write their own answers providing qualitative data.

• Mix of Questions: Combining question types helps maintain respondent interest.

Design: Language

• Accessible Language: Avoid jargon, abbreviations, and colloquialisms.

• Consider Words Carefully:

  • Is the word common in everyday use?

  • Is there a simpler alternative?

  • For specialist language, ensure it has been tested with the relevant group.

  • Have someone else review the questions for clarity.

Design: Wording of Questions

• Avoid Confusion:

  • Refrain from double-barreled questions (asking two instead of one).

  • Avoid leading or loaded questions.

  • Eliminate double negatives to prevent confusion.

  • Be cautious of ambiguous wording.

  • Keep sentences concise; avoid complex structures.

  • Avoid assumptions that might misguide respondents.

Design: Choice of Responses

• Comprehensive Options: Ensure that all possible responses are listed (including options like "other," "don’t know," or "not applicable").

• Likert Scales: Decide if a central response option should be included (e.g., "I always prepare well for lectures: strongly agree, agree, neither, disagree, strongly disagree").

Design: Order of Questions

• Pilot Testing: Test questionnaire for logical flow and question order.

• Personal Questions Placement:

  • Consider placing personal questions at the beginning vs. the end.

• Funnel Approach: Start with broad questions that gradually narrow in focus.

• Non-Threatening Start: Initiate with easier, non-threatening questions.

• Logical Flow: Ensure a smooth transition between ideas and topics throughout the survey.

Design: Appearance/Layout/Length

• Visual Design Factors:

  • Typeface and spacing considerations for readability.

  • Avoid printing on both sides of pages to minimize confusion.

  • Decide between an online format or paper copy.

  • Consider paper and font color, as well as paper size for optimal engagement.

Design: Instructions for Completion

• Initial Consent: Obtain consent at the beginning of the questionnaire.

• Clear Instructions: Make sure instructions are logical and distinct from questions (e.g., bolded).

• Filter Questions: Use logical filters to guide respondents.

• Number Questions: Number all questions for clarity.

• Return Instructions: Provide details on how, where, and when to return the completed questionnaire.

• Thank Respondents: Include a thank-you note at the end and offer additional information if necessary (Debrief).

Analysis

• Data Analysis Plan:

  • Determine how answers will be analyzed for each question.

  • Numerical values are needed for closed questions.

  • Utilize descriptive statistics (bar charts and percentages).

  • Employ means, standard deviations, or statistical tests as required.

  • Explore relationships or differences between groups or responses.

  • For qualitative data, plan to perform thematic analysis.

Using JISC Online Survey

• Supervisor Account: Requirement for the supervisor to obtain the account.

• Ease of Use: The platform is user-friendly for survey creation.

• Statistical Functions: Capable of generating descriptive statistics; provides graphs and compatibility with Excel/SPSS.

• Sharing Features: Offers easy sharing capabilities for analyses and outcomes.

Piloting Your Questionnaire

• Test Sample: Trial the questionnaire with a sample group to assess usability and understanding.

• Expected Responses: Verify if trial responses align with expectations and research objectives.

• Check List: Use provided questionnaire checklist on Blackboard for improvements.

References

• Bowling, A. (2014). Research methods in health: Investigating health and health services. McGraw-Hill Education. Chapter 13: Questionnaire Design.