
Moderating Usability Tests
Principles and Practices for Interacting
By:Â Joseph Dumas, Beth Loring
Paperback | 29 February 2008 | Edition Number 1
At a Glance
208 Pages
17.78 x 15.24 x 0.64
Paperback
RRP $77.95
$75.75
or 4 interest-free payments of $18.94 with
 orÂShips in 5 to 7 business days
Moderating Usability Tests is the place for new and experienced moderators to learn about the rules and practices for interacting that have never been described in one place before. Authors Dumas and Loring draw on their combined 40 years of usability testing experience to develop and present the most effective principles and practices - both practical and ethical --for moderating successful usability tests.
To help usability professionals, students, and novices understand these principles, the authors provide videos from their lab that demonstrate good and poor interaction as well as commentary from a panel of testing experts on why certain techniques succeed or fail. The videos are accessible from the publisher's companion web site.
- Presents the ten "golden rules" that maximize every session's value
- Offers targeted advice on how to maintain objectivity
- Discusses the ethical considerations that apply in all usability testing
- Explains how to reduce the stress that participants often feel
- Considers the special requirements of remote usability testing
- Demonstrates good and bad moderating techniques with laboratory videos accessible from the publisher's companion web site
Industry Reviews
| Preface | p. xiii |
| Acknowledgments | p. xv |
| About the Authors | p. xvii |
| Introduction | p. 1 |
| Why This Book? | p. 1 |
| What Is Usability Testing? | p. 2 |
| The Importance of Moderating Skills | p. 3 |
| The Golden Rules of Moderating | p. 3 |
| Cultural Points of View | p. 4 |
| About the Sidebars in This Book | p. 4 |
| About the Videos that Accompany This Book | p. 4 |
| About the Companion Web Site | p. 5 |
| Getting started as a test moderator | p. 7 |
| What Makes a Great Moderator? | p. 7 |
| Understanding usability testing | p. 7 |
| The basics of interacting | p. 8 |
| The ability to establish and maintain a rapport | p. 8 |
| Lots of practice | p. 9 |
| Roles of a Moderator | p. 9 |
| The Gracious Host | p. 9 |
| The Leader | p. 10 |
| The Neutral Observer | p. 10 |
| Other possible roles | p. 11 |
| When roles change | p. 11 |
| When roles conflict | p. 11 |
| Testing Locations | p. 12 |
| Test Preparation | p. 12 |
| Planning ahead | p. 12 |
| Planning for many tasks | p. 14 |
| Understanding the domain and product | p. 15 |
| Jump-Starting Your Moderating Skills | p. 15 |
| Six things you can do first | p. 15 |
| The big challenges | p. 16 |
| Golden rules 1 through 5 | p. 19 |
| Rule 1: Decide How to Interact Based on the Purpose of the Test | p. 20 |
| The type of test | p. 20 |
| The product's stage of development | p. 21 |
| Relationship with developers | p. 22 |
| Rule 2: Protect Participants' Rights | p. 23 |
| Compensation | p. 23 |
| Informed consent | p. 23 |
| Confidentiality | p. 24 |
| Balance of purpose and risk | p. 26 |
| Priorities | p. 26 |
| Rule 3: Remember Your Responsibility to Future Users | p. 26 |
| Letting participants struggle | p. 27 |
| Conflicting responsibilities | p. 28 |
| Rule 4: Respect the Participants as Experts, but Remain in Charge | p. 28 |
| Controlling logistics and pacing | p. 28 |
| Stopping unacceptable behavior | p. 29 |
| Dealing with uncertainty | p. 29 |
| Projecting authority | p. 30 |
| Dispelling negativity | p. 31 |
| Managing visitors | p. 32 |
| Rule 5: Be Professional, Which Includes Being Genuine | p. 33 |
| Dos for making and maintaining a connection | p. 33 |
| Don'ts for making and maintaining a connection | p. 35 |
| When you're not in the room | p. 37 |
| Golden rules 6 through 10 | p. 39 |
| Rule 6: Let the Participants Speak! | p. 39 |
| Speakership | p. 40 |
| Appropriate interruptions | p. 40 |
| Judicious speaking | p. 41 |
| Silent communication | p. 41 |
| Rule 7: Remember That Your Intuition Can Hurt and Help You | p. 42 |
| Your intuition can hurt you | p. 42 |
| Your intuition can help you | p. 42 |
| Rule 8: Be Unbiased | p. 43 |
| Use an unbiased test script | p. 43 |
| Use unbiased questions | p. 44 |
| Keep answers unbiased | p. 45 |
| Watch nonverbal cues | p. 45 |
| Rule 9: Don't Give Away Information Inadvertently | p. 46 |
| Giving an assist | p. 46 |
| Explaining the designer's intent or being defensive | p. 47 |
| Recording all suggestions | p. 48 |
| Rule 10: Watch Yourself to Keep Sharp | p. 48 |
| Initial contacts | p. 51 |
| Recruiting | p. 51 |
| Contacting participants | p. 52 |
| Advertising | p. 53 |
| Explaining the test | p. 54 |
| Screening candidates | p. 57 |
| Confirming appointments | p. 59 |
| When Participants Arrive | p. 59 |
| Greeting participants | p. 60 |
| Creating comfort | p. 60 |
| Obtaining informed consent | p. 61 |
| The Pretest Briefing | p. 64 |
| Preparing yourself | p. 64 |
| Preparing participants | p. 64 |
| Using a script or checklist | p. 65 |
| Practicing the think-aloud technique | p. 66 |
| Confirming that participants are ready | p. 67 |
| Transitioning to the Tasks | p. 68 |
| Starting the tasks | p. 68 |
| conducting a pretest interview | p. 68 |
| Interacting during the session | p. 71 |
| Interacting for a Reason | p. 71 |
| Keeping Them Talking | p. 72 |
| Prompting as a reminder | p. 72 |
| Prompting the silent ones | p. 73 |
| When and How to Probe | p. 73 |
| Probing questions | p. 74 |
| Planned versus spontaneous probes | p. 74 |
| Probes to avoid | p. 75 |
| Common probes | p. 75 |
| Providing Encouragement | p. 76 |
| Encouraging statements to avoid | p. 76 |
| Common encouraging statements | p. 77 |
| Dealing with Failure | p. 77 |
| Participants' self-blame | p. 78 |
| The moderator's distress | p. 78 |
| The participant's distress | p. 79 |
| Responses to participants' distress | p. 80 |
| Stopping a test | p. 81 |
| What you shouldn't do when a participant fails | p. 82 |
| Providing Assistance | p. 83 |
| An assist | p. 83 |
| Giving assistance | p. 84 |
| Interventions versus assists | p. 85 |
| Not giving assistance | p. 85 |
| Levels of assistance | p. 86 |
| Completing a task for a participant | p. 87 |
| Measuring assists | p. 88 |
| Interacting during post-test activities | p. 91 |
| Maintaining Your Roles | p. 91 |
| Determining the Order of Activities | p. 92 |
| Clarifying Things That Occurred during the Test | p. 93 |
| Administering Ratings and Questionnaires | p. 94 |
| Questionnaires | p. 94 |
| Reasons behind the ratings | p. 95 |
| Accuracy of ratings | p. 96 |
| Asking Open-Ended Questions | p. 97 |
| Allowing Others to Interact with Participants | p. 98 |
| Final Activities | p. 100 |
| Providing incentives | p. 100 |
| Ending the session | p. 101 |
| Interacting in a remote test session | p. 105 |
| What Is Remote Testing? | p. 105 |
| Synchronous and asynchronous testing | p. 105 |
| The technology | p. 106 |
| Advantages and disadvantages | p. 107 |
| Preparing for the Session | p. 109 |
| Recruiting | p. 109 |
| Obtaining informed consent and confidentiality | p. 110 |
| Determining the equipment candidates have | p. 110 |
| Establishing willingness and downloading software | p. 113 |
| Interacting during the Session | p. 114 |
| Establishing what participants see on their screen | p. 116 |
| Providing instructions on thinking aloud | p. 116 |
| Making the task scenarios available to participants | p. 117 |
| Avoiding dependencies between tasks | p. 118 |
| Managing visitors during the session | p. 118 |
| Dealing with distractions at the participants' end | p. 119 |
| Making a connection despite the physical distance | p. 121 |
| Moderator-participant arrangements | p. 123 |
| A Bit of History | p. 124 |
| Physical Arrangement | p. 125 |
| The moderator in the test room | p. 125 |
| The moderator not in the test room | p. 126 |
| Beliefs about Arrangements | p. 126 |
| Physical separation | p. 126 |
| Physical proximity | p. 127 |
| Choice of Arrangement | p. 128 |
| Being physically close to participants | p. 128 |
| Being physically separated from participants | p. 129 |
| Considerations for the Practitioner | p. 130 |
| Interacting with diverse populations | p. 133 |
| General Guidelines | p. 134 |
| People with Physical Disabilities | p. 138 |
| Interacting with the physically disabled | p. 139 |
| Interacting with blind participants | p. 140 |
| Interacting with deaf and hard-of-hearing participants | p. 143 |
| The Elderly | p. 145 |
| Recruiting elders | p. 145 |
| Interacting with elders | p. 146 |
| People Who Have Low Literacy Skills | p. 147 |
| Functional illiteracy | p. 147 |
| Interacting with functionally illiterate participants | p. 148 |
| Testing with low-literacy participants | p. 149 |
| Children and Teens | p. 149 |
| Grouping children by age | p. 150 |
| Recruiting children and teens | p. 150 |
| Interacting during the session | p. 152 |
| People From Other Cultures | p. 152 |
| Interacting with participants from the same and other cultures | p. 153 |
| Adapting your techniques | p. 155 |
| Integrating the videos | p. 157 |
| About the Videos | p. 157 |
| The test session videos | p. 157 |
| Use of the videos | p. 158 |
| Content of the Videos | p. 159 |
| Video 1: Pretest briefing with a checklist | p. 159 |
| Video 2: Pretest briefing following a script | p. 159 |
| Video 3: Interacting during the session, example 1 | p. 162 |
| Video 4: Interacting during the session, example 2 | p. 162 |
| Video 5: Interacting in a remote testing situation | p. 162 |
| Video 6: Post-test interview | p. 162 |
| The Future of Usability Testing | p. 162 |
| Current trends | p. 164 |
| What's next? | p. 167 |
| References | p. 169 |
| Index | p. 175 |
| Table of Contents provided by Ingram. All Rights Reserved. |
ISBN: 9780123739339
ISBN-10: 0123739330
Series: Morgan Kaufmann Series in Interactive Technologies
Published: 29th February 2008
Format: Paperback
Language: English
Number of Pages: 208
Audience: Professional and Scholarly
Publisher: Morgan Kaufmann Publishing
Country of Publication: US
Edition Number: 1
Dimensions (cm): 17.78 x 15.24 x 0.64
Weight (kg): 0.43
Shipping
| Standard Shipping | Express Shipping | |
|---|---|---|
| Metro postcodes: | $9.99 | $14.95 |
| Regional postcodes: | $9.99 | $14.95 |
| Rural postcodes: | $9.99 | $14.95 |
Orders over $79.00 qualify for free shipping.
How to return your order
At Booktopia, we offer hassle-free returns in accordance with our returns policy. If you wish to return an item, please get in touch with Booktopia Customer Care.
Additional postage charges may be applicable.
Defective items
If there is a problem with any of the items received for your order then the Booktopia Customer Care team is ready to assist you.
For more info please visit our Help Centre.
You Can Find This Book In

Everything You Need to Ace Computer Science and Coding in One Big Fat Notebook (UK Edition)
Big Fat Notebooks
Paperback
RRP $29.99
$22.75
OFF

Ultimate Beginner's Guide for Minecrafters
Unofficial Tips and Tricks to Survive and Thrive in the Overworld!
Hardcover
RRP $44.99
$37.75
OFF






















