SLOW SEARCH Jaime Teevan, Kevyn Collins-Thompson, Ryen White, Susan Dumais and Yubin Kim.
-
Upload
joella-nash -
Category
Documents
-
view
215 -
download
0
Transcript of SLOW SEARCH Jaime Teevan, Kevyn Collins-Thompson, Ryen White, Susan Dumais and Yubin Kim.
![Page 1: SLOW SEARCH Jaime Teevan, Kevyn Collins-Thompson, Ryen White, Susan Dumais and Yubin Kim.](https://reader030.fdocuments.us/reader030/viewer/2022032705/56649dc85503460f94abd5c2/html5/thumbnails/1.jpg)
SLOW SEARCHJaime Teevan, Kevyn Collins-Thompson, Ryen White, Susan Dumais and Yubin Kim
![Page 2: SLOW SEARCH Jaime Teevan, Kevyn Collins-Thompson, Ryen White, Susan Dumais and Yubin Kim.](https://reader030.fdocuments.us/reader030/viewer/2022032705/56649dc85503460f94abd5c2/html5/thumbnails/2.jpg)
Slow Movements
![Page 3: SLOW SEARCH Jaime Teevan, Kevyn Collins-Thompson, Ryen White, Susan Dumais and Yubin Kim.](https://reader030.fdocuments.us/reader030/viewer/2022032705/56649dc85503460f94abd5c2/html5/thumbnails/3.jpg)
Speed Focus in Search Reasonable
![Page 4: SLOW SEARCH Jaime Teevan, Kevyn Collins-Thompson, Ryen White, Susan Dumais and Yubin Kim.](https://reader030.fdocuments.us/reader030/viewer/2022032705/56649dc85503460f94abd5c2/html5/thumbnails/4.jpg)
Not All Searches Need to Be Fast
• Long-term tasks• Long search sessions• Multi-session searches
• Social search• Question asking
• Technologically limited• Limited connectivity• Mobile devices• Search from space
![Page 5: SLOW SEARCH Jaime Teevan, Kevyn Collins-Thompson, Ryen White, Susan Dumais and Yubin Kim.](https://reader030.fdocuments.us/reader030/viewer/2022032705/56649dc85503460f94abd5c2/html5/thumbnails/5.jpg)
Making Use of Additional Time
![Page 6: SLOW SEARCH Jaime Teevan, Kevyn Collins-Thompson, Ryen White, Susan Dumais and Yubin Kim.](https://reader030.fdocuments.us/reader030/viewer/2022032705/56649dc85503460f94abd5c2/html5/thumbnails/6.jpg)
TIME + SEARCHUnderstand how time influences the search experience
![Page 7: SLOW SEARCH Jaime Teevan, Kevyn Collins-Thompson, Ryen White, Susan Dumais and Yubin Kim.](https://reader030.fdocuments.us/reader030/viewer/2022032705/56649dc85503460f94abd5c2/html5/thumbnails/7.jpg)
Time in Search: Micro Scale
• Impact of sub-second changes in response time• Study using large-scale query log analysis• Natural variation exists within a single query• Measure interaction as f(response time)
• Time to click• Abandonment rate
![Page 8: SLOW SEARCH Jaime Teevan, Kevyn Collins-Thompson, Ryen White, Susan Dumais and Yubin Kim.](https://reader030.fdocuments.us/reader030/viewer/2022032705/56649dc85503460f94abd5c2/html5/thumbnails/8.jpg)
Small Increases Big Changes
500 600 700 800 900 1000 1100 1200 1300 1400 15000.9
1
1.1
1.2
1.3
1.4
Page Load Time (ms)
Rel
ativ
e T
ime
To
Cli
ck
500 600 700 800 900 1000 1100 1200 1300 1400 15000.9
1
1.1
1.2
1.3
1.4
NavigationalInformational
![Page 9: SLOW SEARCH Jaime Teevan, Kevyn Collins-Thompson, Ryen White, Susan Dumais and Yubin Kim.](https://reader030.fdocuments.us/reader030/viewer/2022032705/56649dc85503460f94abd5c2/html5/thumbnails/9.jpg)
1 10 100 10000.9
1.2
Time Spent Searching (mins)
500 600 700 800 900 1000 1100 1200 1300 1400 15000.9
1.2
Page Load Time (ms)
Impact of Sub-Second Changes
• Imperceptible changes impact behavior• Impact of slower page load time
• Slower time to click• Increased abandonment
• Some queries more sensitive to time than others• Time impacts navigational queries > informational• Informational queries less impacted by very slow results
![Page 10: SLOW SEARCH Jaime Teevan, Kevyn Collins-Thompson, Ryen White, Susan Dumais and Yubin Kim.](https://reader030.fdocuments.us/reader030/viewer/2022032705/56649dc85503460f94abd5c2/html5/thumbnails/10.jpg)
Time in Search: Macro Scale
• Impact of longer changes in response time• Two user surveys with 1476 participants in total
• Detailed survey with 141 MSFT employees• Online survey with 1335 people
• Asked about the participant’s last search• Willingness to wait for results as f(response time)
1 10 100 10000.9
1.2
Time Spent Searching (mins)
![Page 11: SLOW SEARCH Jaime Teevan, Kevyn Collins-Thompson, Ryen White, Susan Dumais and Yubin Kim.](https://reader030.fdocuments.us/reader030/viewer/2022032705/56649dc85503460f94abd5c2/html5/thumbnails/11.jpg)
Last Search Took Minutes or Hours
1 10 100 10000.0
0.2
0.4
0.6
0.8
1.0
Time Spent Searching (mins)
Pro
bab
ilit
y o
f S
earc
hin
g t
hat
Lo
ng
![Page 12: SLOW SEARCH Jaime Teevan, Kevyn Collins-Thompson, Ryen White, Susan Dumais and Yubin Kim.](https://reader030.fdocuments.us/reader030/viewer/2022032705/56649dc85503460f94abd5c2/html5/thumbnails/12.jpg)
Time Constraints in Search
• Reported spending more time on some searches• Important tasks• Tasks with a deadline• Tasks with bad search results
• Time constraints• 34% of tasks needed results urgently• 39% of tasks needed results by a deadline• 27% of tasks needed results whenever
![Page 13: SLOW SEARCH Jaime Teevan, Kevyn Collins-Thompson, Ryen White, Susan Dumais and Yubin Kim.](https://reader030.fdocuments.us/reader030/viewer/2022032705/56649dc85503460f94abd5c2/html5/thumbnails/13.jpg)
Willingness to Wait
• Time willing to wait < actual time spent searching• Participants do not trust the search engine
• 28% people said they want “fast results always”
• For important tasks• Spent more time searching than less important• Willing to wait less than less important
![Page 14: SLOW SEARCH Jaime Teevan, Kevyn Collins-Thompson, Ryen White, Susan Dumais and Yubin Kim.](https://reader030.fdocuments.us/reader030/viewer/2022032705/56649dc85503460f94abd5c2/html5/thumbnails/14.jpg)
Willing to Wait for Quality Results
1 10 100 10000.0
0.2
0.4
0.6
0.8
1.0
PerfectMuch BetterBetterSlightly Better
Wait Time (mins)
Pro
bab
ilit
y o
f S
earc
hin
g t
hat
Lo
ng
![Page 15: SLOW SEARCH Jaime Teevan, Kevyn Collins-Thompson, Ryen White, Susan Dumais and Yubin Kim.](https://reader030.fdocuments.us/reader030/viewer/2022032705/56649dc85503460f94abd5c2/html5/thumbnails/15.jpg)
Impact of Longer Intervals of Time
• People do not want to wait, but…• Report spending a lot of time on important tasks
• 90% of the important tasks took more than 1 minute• 23% of respondents found their results unacceptable
• Are willing wait in some cases• When the results obtained were poor• When a perfect answer is sought
![Page 16: SLOW SEARCH Jaime Teevan, Kevyn Collins-Thompson, Ryen White, Susan Dumais and Yubin Kim.](https://reader030.fdocuments.us/reader030/viewer/2022032705/56649dc85503460f94abd5c2/html5/thumbnails/16.jpg)
Summary
![Page 17: SLOW SEARCH Jaime Teevan, Kevyn Collins-Thompson, Ryen White, Susan Dumais and Yubin Kim.](https://reader030.fdocuments.us/reader030/viewer/2022032705/56649dc85503460f94abd5c2/html5/thumbnails/17.jpg)
QUESTIONS?Jaime Teevan [email protected] Yubin Kim [email protected]