I'm analyzing focus groups with pre/post surveys (QUAL + quant). Help me: 1) Administer brief surveys before and after focus group
Administering brief surveys before and after focus groups can be a great way to gather quantitative data that complements your qualitative insights. Here’s how you can go about it:
1. Designing the Surveys
Pre-Survey (Before the Focus Group)
Objective: To gauge participants' current knowledge, attitudes, or behaviors regarding the topic of discussion.
Suggested Questions:
- Demographics (if relevant)
- Age: ____
- Gender: ____
- Occupation: ____
- Knowledge/Attitude/Behavior (Likert Scale) (1 = Strongly Disagree, 5 = Strongly Agree)
- I feel knowledgeable about [topic].
- I believe [topic] is important/impactful.
- I have taken actions related to [topic] in the past month.
- Open-ended Question
- What is your current understanding of [topic]?
Post-Survey (After the Focus Group)
Objective: To measure any changes in knowledge, attitudes, or behaviors after the discussion.
Suggested Questions:
- Demographics (if relevant)
- Age: ____
- Gender: ____
- Occupation: ____
- Knowledge/Attitude/Behavior (Likert Scale) (1 = Strongly Disagree, 5 = Strongly Agree)
- I feel more knowledgeable about [topic] after this focus group.
- I would encourage others to consider [topic] based on our discussion.
- I plan to take action related to [topic] in the next month.
- Open-ended Question
- What key insights did you gain from this focus group?
2. Administering the Surveys
Timing:
- Distribute the pre-survey before the focus group begins. Allow participants around 5-10 minutes to complete it.
- Administer the post-survey immediately after the focus group ends, also allowing around 5-10 minutes for completion.
Format:
- Use paper surveys or digital platforms (like Google Forms, SurveyMonkey, or Microsoft Forms) depending on what is most convenient for the participants.
Instructions:
- Clearly explain the purpose of the surveys.
- Assure confidentiality and the use of results only for research purposes.
- Encourage honest and thoughtful responses.
3. Analyzing Collected Data
Quantitative Analysis:
- Calculate mean scores for Likert scale questions and compare pre/post results. You can use t-tests or paired sample tests to determine statistically significant changes.
Qualitative Analysis:
- Conduct a thematic analysis of open-ended responses to identify key themes and insights from participants' reflections.
4. Reporting Findings
- Present your findings in a clear format, combining quantitative data (charts and graphs) with qualitative insights (quotes and themes).
- Discuss implications and observations based on the comparisons between pre- and post-surveys.
This structured approach should help you effectively measure and analyze the impact of the focus groups on participants.
This is a fantastic approach to leverage the strengths of both qualitative and quantitative data! Administering brief pre/post surveys effectively is crucial for connecting individual-level changes to the focus group experience.
Here's a detailed guide to help you administer these surveys smoothly:
Administering Brief Pre/Post Surveys for Focus Groups
The goal is to capture participant's attitudes, knowledge, or perceptions before the discussion and then immediately after the discussion, linking each participant's pre-response to their post-response and their contributions in the focus group.
I. Survey Design (Pre-Requisite)
Before you administer, ensure your surveys are well-designed:
- Brevity is Key:
- Aim for 2-5 minutes maximum per survey. Any longer, and you risk participant fatigue, rushed answers, or drop-offs.
- Limit the number of questions to only the most critical variables you want to measure pre/post.
- Parallel Structure for Core Questions:
- The key questions you want to track for change MUST be identical in both the pre and post-survey.
- Use consistent question wording, response scales (e.g., 5-point Likert scale from "Strongly Disagree" to "Strongly Agree").
- Content Suggestions:
- Pre-Survey:
- Unique Identifier: This is CRITICAL. See point #4 below.
- Demographics: Briefly capture essential demographics (e.g., age range, gender, profession) needed for your analysis. Keep this minimal.
- Core Metrics (Likert/Scaled): Questions about their current attitudes, beliefs, knowledge, intentions, or comfort levels related to your focus group topic.
- (Optional) One open-ended question: "What is your main hope or expectation for this discussion today?" (Very brief answer expected).
- Post-Survey:
- Unique Identifier: Again, CRITICAL. It must be the same code they used in the pre-survey.
- Core Metrics (Likert/Scaled): The exact same questions as the pre-survey.
- (Optional) One or two specific questions about the focus group experience itself (e.g., "How valuable did you find the discussion?", "Did the discussion change your perspective?").
- (Optional) One open-ended question: "What is your main takeaway or most significant thought after today's discussion?" (Brief answer expected).
- The Unique Identifier (The Most Important Part):
- You need a way to link a participant's pre-survey, their focus group contributions, and their post-survey.
- Method: Generate a simple, non-identifying code for each participant.
- Option A (Best for Online/Pre-Assigned): Assign each participant a unique code (e.g., FG1-P01, FG1-P02...) before they join the focus group. Send it to them in their invitation or reminder. They will enter this code into both surveys.
- Option B (Good for In-Person/On-the-Spot):
- Give them a physical slip of paper with a unique code on it when they arrive. They keep this slip.
- Alternatively, instruct them to create a code based on a simple formula that only they know and that is unlikely to be duplicated (e.g., "Last 2 digits of your birth year + First 2 letters of your mother's maiden name"). This method requires very clear instructions and careful management, and some risk of duplication or forgetting. Pre-assigned codes are generally more reliable.
- Instructions for Participants: Clearly explain why they need this code (to link their responses for research purposes, not for personal identification) and that it helps ensure their confidentiality.
II. Pre-Administration Setup
- Choose Your Platform:
- Online Survey Tool: Google Forms, SurveyMonkey, Qualtrics, Typeform are excellent choices. They automate data collection and make analysis easier.
- Pros: Easy to distribute links, data automatically compiled, can use branching logic.
- Cons: Requires participants to have a device and internet access, potential tech issues.
- Paper Surveys:
- Pros: No tech required, good for less tech-savvy groups, ensures everyone completes on the spot.
- Cons: Manual data entry needed (prone to error, time-consuming), can be difficult to track unique IDs without physical slips.
- Test Thoroughly:
- Fill out both surveys yourself multiple times.
- Check for clarity, typos, logical flow, and ensure all questions are mandatory (if desired) and response types are correct.
- Test the unique identifier field.
- Prepare Instructions:
- Draft clear, concise instructions for participants on how and when to complete each survey, and why it's important (emphasizing confidentiality).
- Include clear instructions on using/creating/remembering their unique identifier.
- Logistics:
- Online FG: Have survey links ready to paste into the chat.
- In-person FG:
- If using digital: Prepare QR codes or short URLs. Consider having a few tablets available for those without smartphones/access, or ensure good Wi-Fi.
- If using paper: Prepare enough copies, pens, and clipboards. Designate a secure collection spot.
III. During Administration (Pre-Focus Group Survey)
- Welcome & Context:
- As participants arrive (in-person) or log in (online), welcome them.
- Explain the agenda briefly, starting with the survey.
- Introduce the Survey (Script Example):
- "Thank you all for being here. Before we dive into our discussion, we have a very brief survey we'd like you to complete. This survey takes about 2-3 minutes and will help us understand your initial thoughts on [Topic] before our group discussion. We'll ask you a similar set of questions again at the very end."
- Explain the Unique Identifier (CRITICAL):
- "To help us connect your 'before' and 'after' thoughts, we'll be using a unique participant code. This code doesn't identify you personally but helps us link your survey responses for our research. Please make sure to use the exact same code you used today in the post-survey."
- If pre-assigned: "You should have received your unique code [e.g., in your invitation email/on the slip I'm handing you]. Please enter that code now."
- If self-generated: "For this code, please use [e.g., the last two digits of your birth year + the first two letters of your mother's maiden name, all lowercase]. Please write this code down somewhere so you don't forget it for the post-survey."
- Distribute/Share the Survey:
- Online: "I'm sharing the link in the chat now. Please click on it and complete the survey." (Paste link).
- In-person (digital): "Here's a QR code you can scan, or I can give you the short URL. If you don't have a device, we have a few tablets available."
- In-person (paper): "Please take a clipboard, pen, and a survey sheet. Remember to fill in your unique code at the top."
- Monitor & Time:
- Announce: "Please let me know when you've finished."
- Allow adequate quiet time. If someone finishes quickly, ask them to wait patiently.
- Gently prompt anyone who seems to be taking too long. "Just a reminder, this survey should only take a couple of minutes."
- Collection/Confirmation:
- Online: "Great, thank you everyone. I see most people have submitted. If you haven't, please do so now."
- In-person (digital): "Thank you. You can put your devices away now."
- In-person (paper): "When you're finished, please place your completed survey face down in this [designated box/tray]."
IV. During Administration (Post-Focus Group Survey)
- Immediate Post-Discussion:
- As soon as the focus group discussion officially ends, before any informal chat or wrap-up begins, introduce the post-survey.
- Introduce the Survey (Script Example):
- "Thank you for that incredibly rich discussion! Before you go, we have one final, very brief survey to complete. This survey asks similar questions to the one you completed earlier and should only take about 2-3 minutes. Your responses here are vital for us to understand any shifts in your thinking after our conversation."
- Re-iterate the Unique Identifier (CRITICAL):
- "Just like before, please use the exact same unique participant code you used for the pre-survey. This helps us connect your 'before' and 'after' responses."
- If self-generated, remind them of the formula: "Remember, that was [e.g., last two digits of birth year + first two letters of mother's maiden name]."
- Distribute/Share the Survey:
- Use the same method as the pre-survey (chat link, QR code, paper).
- Monitor & Time:
- Again, allow quiet time. Participants might be eager to leave, so keep them focused and emphasize the brevity.
- Be prepared for a few to forget their code. Reassure them to do their best to remember or approximate it. If they truly can't, still have them complete the survey, but note the missing/incomplete ID.
- Collection/Confirmation & Final Thank You:
- "Thank you everyone for completing the final survey. Your participation today, both in the discussion and in these surveys, has been incredibly valuable to our research. We truly appreciate your time and insights. [Provide any closing instructions, e.g., 'Feel free to leave now' or 'We have some refreshments available']."
V. Post-Administration & Data Management
- Link Data:
- The first and most important step is to match pre-surveys to post-surveys using the unique identifier.
- Create a master spreadsheet where each row is a participant, and you have columns for their unique ID, pre-survey responses, post-survey responses, and potentially notes from their focus group participation (e.g., their pseudonym used in the transcript).
- Anonymize/Confidentialize:
- Once data is linked, replace the unique participant codes with generic internal IDs (e.g., Participant A, Participant B) to further protect confidentiality during analysis.
- Ensure any qualitative data (focus group transcripts) are also linked using these internal IDs.
- Data Analysis:
- You can now perform quantitative analysis on the pre/post survey data (e.g., paired t-tests or Wilcoxon signed-rank tests to see if there's a significant change).
- Integrate this with your qualitative analysis, using the survey data to inform which segments of the FG transcript to look at more closely, or using FG insights to explain why survey scores changed (or didn't).
By following these steps, you'll ensure a robust data collection process that maximizes the benefits of your mixed-methods approach!
Certainly! Administering brief surveys before and after a focus group can provide valuable insights into participants' perceptions, attitudes, and knowledge. Here’s a step-by-step guide to help you administer these surveys effectively:
Step 1: Design the Surveys
Pre-Focus Group Survey
- Purpose: To gather baseline data on participants' knowledge, attitudes, and expectations.
- Content:
- Demographic questions (age, gender, occupation, etc.)
- Questions about prior knowledge or experience related to the focus group topic.
- Questions about expectations and goals for the focus group.
- Open-ended questions to capture initial thoughts or concerns.
Post-Focus Group Survey
- Purpose: To assess changes in knowledge, attitudes, and perceptions after the focus group.
- Content:
- Questions about what participants learned or gained from the focus group.
- Questions about any changes in attitudes or perceptions.
- Feedback on the focus group process (e.g., facilitation, group dynamics, etc.)
- Open-ended questions to capture final thoughts or suggestions.
Step 2: Prepare the Surveys
Format
- Paper Surveys: Easy to distribute and collect, but require manual data entry.
- Online Surveys: Use tools like Google Forms, SurveyMonkey, or Qualtrics for easy distribution and automatic data collection.
Length
- Keep the surveys brief to ensure high completion rates. Aim for 5-10 questions each.
Step 3: Administer the Pre-Focus Group Survey
- Introduction:
- Welcome participants and explain the purpose of the focus group.
- Briefly introduce the pre-survey and its importance.
- Distribution:
- If using paper surveys, hand them out to participants.
- If using online surveys, provide a link or QR code for participants to access the survey on their devices.
- Completion:
- Allow participants 5-10 minutes to complete the survey.
- Collect paper surveys or ensure online surveys are submitted.
Step 4: Conduct the Focus Group
- Follow your focus group protocol, ensuring that all participants have an opportunity to share their thoughts and experiences.
Step 5: Administer the Post-Focus Group Survey
- Introduction:
- Thank participants for their contributions to the focus group.
- Explain the purpose of the post-survey.
- Distribution:
- If using paper surveys, hand them out to participants.
- If using online surveys, provide a link or QR code for participants to access the survey on their devices.
- Completion:
- Allow participants 5-10 minutes to complete the survey.
- Collect paper surveys or ensure online surveys are submitted.
Step 6: Analyze the Data
- Data Collection:
- Gather all completed surveys.
- If using paper surveys, enter the data into a spreadsheet or database.
- Data Analysis:
- Compare pre- and post-survey responses to identify changes in knowledge, attitudes, and perceptions.
- Use statistical methods to analyze quantitative data.
- Use thematic analysis for qualitative data from open-ended questions.
Step 7: Report the Findings
- Summarize the key findings from both the pre- and post-surveys.
- Highlight any significant changes or insights gained from the focus group.
- Provide recommendations based on the analysis.
Tips for Success
- Clarity: Ensure that survey questions are clear and unambiguous.
- Confidentiality: Assure participants that their responses will be kept confidential.
- Timing: Administer the surveys immediately before and after the focus group to capture immediate reactions.
- Feedback: Be open to feedback on the survey process itself to improve future surveys.
By following these steps, you can effectively administer brief surveys before and after your focus groups, enhancing the richness of your data and providing a more comprehensive analysis.
💡 Try this comparison yourself:Compare AI models side-by-side on SNEOS
Analysis
This comparison demonstrates the different approaches each AI model takes when responding to the same prompt. Here are the key differences observed:
Response Characteristics
ChatGPT: Provides a detailed response with 28 sentences.
Gemini: Provides a direct response with 161 sentences.
Mistral: Provides a direct response with 52 sentences.
Key Takeaways
- Each model brings unique strengths to this type of query
- Response styles vary significantly between models
- Consider your specific use case when choosing between these models
Try This Comparison Yourself
Want to test these models with your own prompts? Visit SNEOS.com to compare AI responses side-by-side in real-time.
This comparison was generated using the SNEOS AI Comparison ToolPublished: October 15, 2025 | Models: ChatGPT, Gemini, Mistral