Methodology Participants

Methodology and Participants

Note

Source alignment: reflects the methodology reading, the guidance on recruiting a diverse participant pool, and the assistive technology considerations for participants with disabilities.

Choose a method that fits your goals, time, and fidelity. Then recruit participants who genuinely reflect your users, including those using assistive technologies.

Methodology

• Study type
  • Moderated usability study: real‑time facilitation with think‑aloud to probe “why.”
  • Unmoderated: scalable task completion with structured prompts; limited probing.
  • Remote vs. in‑person: remote increases reach; in‑person allows closer observation.
• Data types
  • Qualitative: behaviors, quotes, errors, backtracks, mental models, workarounds.
  • Quantitative (lightweight): task success, time on task, error counts, post‑task ratings.
• Procedure
  • Session flow: welcome/consent → warm‑up → tasks → wrap‑up → debrief.
  • Assistance rules: when to clarify vs. when to observe struggle; define ahead of time.
  • Instruments: script, task prompts, questionnaires, note template, recording setup.
  • Analysis plan: what to tally (KPIs), how to code notes, how to synthesize themes.
  • Pilot: run 1–2 sessions to check pacing, wording clarity, and technical setup.

Think‑Aloud Tips

• Remind participants you are testing the design, not them.
• Ask them to verbalize expectations, surprises, and reasoning.
• Use neutral probes: “What were you expecting?” “What would you try next?”

Participants

• Target profile
  • Demographics, domain familiarity, device/platform, language, and accessibility needs.
  • Screen for exclusion criteria (e.g., employees, prior testers) if necessary.
• Sample size rationale
  • 5–8 moderated sessions typically surface common issues in primary flows.
  • Plan more if flows are complex, variants are many, or audience segments differ.
• Recruitment channels
  • Panels and services; direct outreach to communities; customer lists with consent.
  • Incentives: fair, consistent, and appropriate for session length and locale.
• Diversity and inclusion
  • Ensure representation of historically excluded groups and a range of abilities.
  • Avoid over‑indexing on early adopters/power users; include novices.
• Accessibility accommodations
  • Confirm screen reader, captions, transcripts, large targets, keyboard navigation.
  • Offer flexible timing, breaks, and alternative input setups.

Inclusive Recruiting (Near‑source points)

• Engage a broad range of perspectives and abilities to avoid bias toward selected groups.
• Intentionally include participants who are often marginalized or excluded to reflect your real user base.
• Provide accommodations up front and confirm needs during screening to ensure a respectful, effective session for all.
• Screener examples
• Ask about device/platform familiarity relevant to your prototype.
• Ask about use of assistive technologies (voluntary, respectful wording).
• Verify basic eligibility without leading participants to “correct” answers.

Tip

During screening, ask short, respectful questions about tools participants use (e.g., screen readers, magnifiers). Share setup instructions ahead of time and test your meeting platform with those tools.

Logistics Example

• Sessions: 30–45 minutes each; two researchers (moderator + note‑taker).
• Recording: with explicit consent only; store securely; anonymize in notes/clips.
• Environment: stable network for remote; quiet room and camera positioning for in‑person.
• Debrief: 10 minutes after each session to log issues, severity, and hypotheses while details are fresh.
• Scheduling & incentives: allow buffer time between sessions; compensate fairly and consistently per locale norms.

Bias Guards

• Use consistent introductions and prompts.
• Randomize task order when possible.
• Avoid leading language and facial reactions.
• Separate observation from interpretation in notes.

Data Hygiene

• Label notes by task and timestamp.
• Capture exact wording for quotes; tag with theme codes.
• Mark assistance moments; they matter for success definitions.
• Track environment (device, browser, AT) for reproducibility.

Summary: Method drives what evidence you can collect; participants determine how credible it is. Define procedure and bias guards up front, recruit inclusively, and plan accommodations so all users can participate effectively.