Introduction IMD09120: Collaborative Media Brian Davison 2011/12.
Liangjie Hong , Zaihan Yang and Brian D. Davison Computer Science and Engineering
description
Transcript of Liangjie Hong , Zaihan Yang and Brian D. Davison Computer Science and Engineering
![Page 1: Liangjie Hong , Zaihan Yang and Brian D. Davison Computer Science and Engineering](https://reader036.fdocuments.us/reader036/viewer/2022062811/568161e2550346895dd1f6e6/html5/thumbnails/1.jpg)
Incorporating Participant Reputation in Community-driven Question Answering Systems
Liangjie Hong, Zaihan Yang and Brian D. DavisonComputer Science and Engineering
Lehigh UniversityBethlehem, PA USA
![Page 2: Liangjie Hong , Zaihan Yang and Brian D. Davison Computer Science and Engineering](https://reader036.fdocuments.us/reader036/viewer/2022062811/568161e2550346895dd1f6e6/html5/thumbnails/2.jpg)
Liangjie Hong, Zaihan Yang and Brian D. Davison
Why Community-driven Question & Answering ?
SIN August 2009
![Page 3: Liangjie Hong , Zaihan Yang and Brian D. Davison Computer Science and Engineering](https://reader036.fdocuments.us/reader036/viewer/2022062811/568161e2550346895dd1f6e6/html5/thumbnails/3.jpg)
Liangjie Hong, Zaihan Yang and Brian D. Davison
Why Community-driven Question & Answering ?
SIN August 2009
• natural language vs. short queries
![Page 4: Liangjie Hong , Zaihan Yang and Brian D. Davison Computer Science and Engineering](https://reader036.fdocuments.us/reader036/viewer/2022062811/568161e2550346895dd1f6e6/html5/thumbnails/4.jpg)
Liangjie Hong, Zaihan Yang and Brian D. Davison
Why Community-driven Question & Answering ?
SIN August 2009
• natural language vs. short queries• best answers vs. relevance
![Page 5: Liangjie Hong , Zaihan Yang and Brian D. Davison Computer Science and Engineering](https://reader036.fdocuments.us/reader036/viewer/2022062811/568161e2550346895dd1f6e6/html5/thumbnails/5.jpg)
Liangjie Hong, Zaihan Yang and Brian D. Davison
Why Community-driven Question & Answering ?
SIN August 2009
• natural language vs. short queries• best answers vs. relevance• user interactions!
![Page 6: Liangjie Hong , Zaihan Yang and Brian D. Davison Computer Science and Engineering](https://reader036.fdocuments.us/reader036/viewer/2022062811/568161e2550346895dd1f6e6/html5/thumbnails/6.jpg)
Liangjie Hong, Zaihan Yang and Brian D. Davison
Why Community-driven Question & Answering ?
SIN August 2009
• natural language vs. short queries• best answers vs. relevance• user interactions!• 23 millions resolved questions!
![Page 7: Liangjie Hong , Zaihan Yang and Brian D. Davison Computer Science and Engineering](https://reader036.fdocuments.us/reader036/viewer/2022062811/568161e2550346895dd1f6e6/html5/thumbnails/7.jpg)
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
![Page 8: Liangjie Hong , Zaihan Yang and Brian D. Davison Computer Science and Engineering](https://reader036.fdocuments.us/reader036/viewer/2022062811/568161e2550346895dd1f6e6/html5/thumbnails/8.jpg)
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
1 – 10 of 17, 702
![Page 9: Liangjie Hong , Zaihan Yang and Brian D. Davison Computer Science and Engineering](https://reader036.fdocuments.us/reader036/viewer/2022062811/568161e2550346895dd1f6e6/html5/thumbnails/9.jpg)
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
Resolved
Resolved
Resolved
![Page 10: Liangjie Hong , Zaihan Yang and Brian D. Davison Computer Science and Engineering](https://reader036.fdocuments.us/reader036/viewer/2022062811/568161e2550346895dd1f6e6/html5/thumbnails/10.jpg)
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
Earth Science & Geology
Physics
![Page 11: Liangjie Hong , Zaihan Yang and Brian D. Davison Computer Science and Engineering](https://reader036.fdocuments.us/reader036/viewer/2022062811/568161e2550346895dd1f6e6/html5/thumbnails/11.jpg)
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
Problems
![Page 12: Liangjie Hong , Zaihan Yang and Brian D. Davison Computer Science and Engineering](https://reader036.fdocuments.us/reader036/viewer/2022062811/568161e2550346895dd1f6e6/html5/thumbnails/12.jpg)
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
• same or similar questions• different category• different time
Problems
![Page 13: Liangjie Hong , Zaihan Yang and Brian D. Davison Computer Science and Engineering](https://reader036.fdocuments.us/reader036/viewer/2022062811/568161e2550346895dd1f6e6/html5/thumbnails/13.jpg)
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
Problems
Read them all?Trust them all?
![Page 14: Liangjie Hong , Zaihan Yang and Brian D. Davison Computer Science and Engineering](https://reader036.fdocuments.us/reader036/viewer/2022062811/568161e2550346895dd1f6e6/html5/thumbnails/14.jpg)
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
Finding high quality answers
![Page 15: Liangjie Hong , Zaihan Yang and Brian D. Davison Computer Science and Engineering](https://reader036.fdocuments.us/reader036/viewer/2022062811/568161e2550346895dd1f6e6/html5/thumbnails/15.jpg)
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
Finding high quality answers
• content• user reputation
![Page 16: Liangjie Hong , Zaihan Yang and Brian D. Davison Computer Science and Engineering](https://reader036.fdocuments.us/reader036/viewer/2022062811/568161e2550346895dd1f6e6/html5/thumbnails/16.jpg)
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
Finding high quality answers
• content• user reputation
![Page 17: Liangjie Hong , Zaihan Yang and Brian D. Davison Computer Science and Engineering](https://reader036.fdocuments.us/reader036/viewer/2022062811/568161e2550346895dd1f6e6/html5/thumbnails/17.jpg)
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
HITS-like scheme
User
User
User
User
User
User
User
Answerer
Questioner
![Page 18: Liangjie Hong , Zaihan Yang and Brian D. Davison Computer Science and Engineering](https://reader036.fdocuments.us/reader036/viewer/2022062811/568161e2550346895dd1f6e6/html5/thumbnails/18.jpg)
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
HITS-like scheme
User
User
User
User
User
User
User
questioner - hubanswerer - authority
![Page 19: Liangjie Hong , Zaihan Yang and Brian D. Davison Computer Science and Engineering](https://reader036.fdocuments.us/reader036/viewer/2022062811/568161e2550346895dd1f6e6/html5/thumbnails/19.jpg)
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
PageRank-like schemeUser
User User
User
User
![Page 20: Liangjie Hong , Zaihan Yang and Brian D. Davison Computer Science and Engineering](https://reader036.fdocuments.us/reader036/viewer/2022062811/568161e2550346895dd1f6e6/html5/thumbnails/20.jpg)
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
PageRank-like schemeUser
User User
User
User
random jump ?
![Page 21: Liangjie Hong , Zaihan Yang and Brian D. Davison Computer Science and Engineering](https://reader036.fdocuments.us/reader036/viewer/2022062811/568161e2550346895dd1f6e6/html5/thumbnails/21.jpg)
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
PageRank-like schemeUser
User User User
![Page 22: Liangjie Hong , Zaihan Yang and Brian D. Davison Computer Science and Engineering](https://reader036.fdocuments.us/reader036/viewer/2022062811/568161e2550346895dd1f6e6/html5/thumbnails/22.jpg)
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
PageRank-like schemeUser
User User User
probability of interaction
![Page 23: Liangjie Hong , Zaihan Yang and Brian D. Davison Computer Science and Engineering](https://reader036.fdocuments.us/reader036/viewer/2022062811/568161e2550346895dd1f6e6/html5/thumbnails/23.jpg)
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
Incorporating topics
Profile
User
UserUser Profile
Profile
![Page 24: Liangjie Hong , Zaihan Yang and Brian D. Davison Computer Science and Engineering](https://reader036.fdocuments.us/reader036/viewer/2022062811/568161e2550346895dd1f6e6/html5/thumbnails/24.jpg)
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
Incorporating topics
UserUser
User
![Page 25: Liangjie Hong , Zaihan Yang and Brian D. Davison Computer Science and Engineering](https://reader036.fdocuments.us/reader036/viewer/2022062811/568161e2550346895dd1f6e6/html5/thumbnails/25.jpg)
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
Incorporating topics
α -> stay1- α -> jump topic
UserUser
User
![Page 26: Liangjie Hong , Zaihan Yang and Brian D. Davison Computer Science and Engineering](https://reader036.fdocuments.us/reader036/viewer/2022062811/568161e2550346895dd1f6e6/html5/thumbnails/26.jpg)
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
Incorporating topics
α -> stay1- α -> jump topic
d -> follow link1-d -> random jump User
User
User
![Page 27: Liangjie Hong , Zaihan Yang and Brian D. Davison Computer Science and Engineering](https://reader036.fdocuments.us/reader036/viewer/2022062811/568161e2550346895dd1f6e6/html5/thumbnails/27.jpg)
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
Incorporating topics
User
UserUser
α -> stay1- α -> jump topic
d -> follow link1-d -> random jump
![Page 28: Liangjie Hong , Zaihan Yang and Brian D. Davison Computer Science and Engineering](https://reader036.fdocuments.us/reader036/viewer/2022062811/568161e2550346895dd1f6e6/html5/thumbnails/28.jpg)
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
Other heuristics• Z-score
• Linear combination
![Page 29: Liangjie Hong , Zaihan Yang and Brian D. Davison Computer Science and Engineering](https://reader036.fdocuments.us/reader036/viewer/2022062811/568161e2550346895dd1f6e6/html5/thumbnails/29.jpg)
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
Dataset & Evaluation• Yahoo Answers!
14,122 questions + 45,814 answers12,731 users
• Strict & Relaxed Precision@1, MRR, Precision@10, MAP
• BM25 + User Reputation
![Page 30: Liangjie Hong , Zaihan Yang and Brian D. Davison Computer Science and Engineering](https://reader036.fdocuments.us/reader036/viewer/2022062811/568161e2550346895dd1f6e6/html5/thumbnails/30.jpg)
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
Strict Evaluation
![Page 31: Liangjie Hong , Zaihan Yang and Brian D. Davison Computer Science and Engineering](https://reader036.fdocuments.us/reader036/viewer/2022062811/568161e2550346895dd1f6e6/html5/thumbnails/31.jpg)
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
Relaxed Evaluation
![Page 32: Liangjie Hong , Zaihan Yang and Brian D. Davison Computer Science and Engineering](https://reader036.fdocuments.us/reader036/viewer/2022062811/568161e2550346895dd1f6e6/html5/thumbnails/32.jpg)
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
Relaxed Evaluation
![Page 33: Liangjie Hong , Zaihan Yang and Brian D. Davison Computer Science and Engineering](https://reader036.fdocuments.us/reader036/viewer/2022062811/568161e2550346895dd1f6e6/html5/thumbnails/33.jpg)
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
• user reputation helps retrieval• topic modeling makes sense but…
• question answering• link direction
Conclusion
![Page 34: Liangjie Hong , Zaihan Yang and Brian D. Davison Computer Science and Engineering](https://reader036.fdocuments.us/reader036/viewer/2022062811/568161e2550346895dd1f6e6/html5/thumbnails/34.jpg)
SIN August 2009
Thank you!Questions?
Contact Info:Liangjie [email protected] LaboratoryComputer Science and EngineeringLehigh UniversityBethlehem, PA 18015 USA
Liangjie Hong, Zaihan Yang and Brian D. Davison