Saint Vito-Most Holy Trinity Church Saint Vito EASTER SUNDAY
Vito loconte diary-sandwich_poster
1
OVERVIEW First-time use of complex products. At Citrix, we conducted two studies in the past year that combine a digital diary study with multiple usability test sessions. In both cases, our goal was to observe the first-time use of somewhat complex systems: a remote support and IT monitoring system that takes 24 to 48 hours to collect information, and a cloud file storage and management system that also had a mobile app. • In Usability Test #1 , we observed the initial product setup and first-time use. • The Digital Diary helped participants familiarize themselves with the product. As researchers, we used the diaries to track the types of tasks performed and capture any issues that participants encountered during self-guided exploration. • In Usability Test #2 , we interviewed the same participants about the features and functions used during their initial exploration, and also gave them more advanced tasks to perform. Fast digital diary. In the mobile product study, participants recorded voicemail diary entries using Google Voice wherever they were using the mobile app, yielding timely in-context feedback. The voicemail service then provided us with free time-saving transcriptions of the diary entries. TAKEAWAYS Real world. We observed the entire first-time-use experience—in the lab and “in the wild.” The diary entries helped us write tasks for the 2nd usability test based on more realistic scenarios. Digital diary study . Incorporating Google Voice helped participants create voicemail diary entries from their mobile device immediately after using the mobile app we were studying. This also led to participants recording longer and more robust diary entries compared to text-entry diary methods. Providing an extra $10/day compensation helped encourage diary participation. Second usability test. To clarify details not included in the diary entries, participants repeated some of the tasks mentioned in the diaries, so that we could observe them and determine whether the details were important. We also gave participants more advanced tasks to explore advanced features now that they were more familiar with the product. Longitudinal. Over time, participants familiarized themselves with the product, and the product had enough time to collect the data necessary to be fully functional. Flexible and low cost. You can use variations on this method depending on the specific research question and the product or website in question. You don’t need the most comprehensive or expensive tools to begin conducting your own diary studies! Mostly self-guided exploration of product website and product • Observe website exploration • Observe product setup • Observe product first-time use • Discover initial usability issues Self-guided exploration of product • Capture tasks, features, and functionality that participants try on their own • Capture pain points and issues on the go Task-based investigation • Revisit tasks from the diary entries to observe more details • Observe more advanced tasks because participants are now more familiar with the product Usability Test #1 Usability Test #2 + Digital Diary The Diary Sandwich: Rich Mobile Data on a Budget VITO M LOCONTE III 1 digital diary study + 2 usability tests = meaningful insights into first-time use of complex products beyond the usability lab +
Transcript of Vito loconte diary-sandwich_poster
OVERVIEWFirst-time use of complex products. At Citrix, we conducted two studies in the past year that combine a digital diary study with multiple usability test sessions. In both cases, our goal was to observe the first-time use of somewhat complex systems: a remote support and IT monitoring system that takes 24 to 48 hours to collect information, and a cloud file storage and management system that also had a mobile app.
• In Usability Test #1, we observed the initial product setup and first-time use.
• The Digital Diary helped participants familiarize themselves with the product. As researchers, we used the diaries to track the types of tasks performed and capture any issues that participants encountered during self-guided exploration.
• In Usability Test #2, we interviewed the same participants about the features and functions used during their initial exploration, and also gave them more advanced tasks to perform.
Fast digital diary. In the mobile product study, participants recorded voicemail diary entries using Google Voice wherever they were using the mobile app, yielding timely in-context feedback. The voicemail service then provided us with free time-saving transcriptions of the diary entries.
TAKEAWAYSReal world. We observed the entire first-time-use experience—in the lab and “in the wild.” The diary entries helped us write tasks for the 2nd usability test based on more realistic scenarios.
Digital diary study. Incorporating Google Voice helped participants create voicemail diary entries from their mobile device immediately after using the mobile app we were studying. This also led to participants recording longer and more robust diary entries compared to text-entry diary methods. Providing an extra $10/day compensation helped encourage diary participation.
Second usability test. To clarify details not included in the diary entries, participants repeated some of the tasks mentioned in the diaries, so that we could observe them and determine whether the details were important. We also gave participants more advanced tasks to explore advanced features now that they were more familiar with the product.
Longitudinal. Over time, participants familiarized themselves with the product, and the product had enough time to collect the data necessary to be fully functional.
Flexible and low cost. You can use variations on this method depending on the specific research question and the product or website in question. You don’t need the most comprehensive or expensive tools to begin conducting your own diary studies!
Mostly self-guided exploration of
product website and product
•Observe website exploration •Observe product setup •Observe product first-time use •Discover initial usability issues
Self-guided exploration of product
• Capture tasks, features, and functionality that participants try on their own
• Capture pain points and issues on the go
Task-based investigation
• Revisit tasks from the diary entries to observe more details
• Observe more advanced tasks because participants are now more familiar with the product
Usability Test #1
Usability Test #2
+Digital Diary
The Diary Sandwich:Rich Mobile Data on a Budget Vito M Loconte iii
1 digital diary study + 2 usability tests =
meaningful insightsinto first-time use
of complex productsbeyond the usability lab
+
