Demystifying Coveo Machine...

28
Automated Relevance, Query Suggestions and Recommendations Richard Tessier SVP Products 1 © 2017 Coveo Solutions Inc - Proprietary and Confidential Demystifying Coveo Machine Learning

Transcript of Demystifying Coveo Machine...

Page 1: Demystifying Coveo Machine Learningimpact.coveo.com/.../2017/07/Demystifying-Coveo-Machine-Learning… · Demystifying Coveo Machine Learning. 1. Intelligent Query Suggest 2. Automatic

Automated Relevance, Query Suggestions and Recommendations

Richard Tessier

SVP Products

1 © 2017 Coveo Solutions Inc - Proprietary and Confidential

Demystifying Coveo Machine Learning

Page 2: Demystifying Coveo Machine Learningimpact.coveo.com/.../2017/07/Demystifying-Coveo-Machine-Learning… · Demystifying Coveo Machine Learning. 1. Intelligent Query Suggest 2. Automatic

Cop

yrig

ht ©

20

17 C

oveo

Sol

utio

ns In

c.

All

right

s re

serv

ed. P

ropr

ieta

ry a

nd C

ON

FID

ENTI

AL

1. Intelligent Query Suggest

2. Automatic Relevance Tuning

3. Recommendations

4. Intelligent Term Detection

5. Personalization

Key Use Cases

Optimizesfor future users

Analyzesuser behavior

Learnsbased on success

Page 3: Demystifying Coveo Machine Learningimpact.coveo.com/.../2017/07/Demystifying-Coveo-Machine-Learning… · Demystifying Coveo Machine Learning. 1. Intelligent Query Suggest 2. Automatic

3 © 2017 Coveo Solutions Inc - Proprietary and Confidential

General Concepts

Page 4: Demystifying Coveo Machine Learningimpact.coveo.com/.../2017/07/Demystifying-Coveo-Machine-Learning… · Demystifying Coveo Machine Learning. 1. Intelligent Query Suggest 2. Automatic

4

Coveo Machine Learning Flow

Interface & APIs

Transmit interaction events and leverages the models built using these events

Predictive analytics

Wisdom from the interactions’ sumtotalcues likely intent

Machine learning

Data science drives “what you need next” recommendations

Users RelevanceModels-> =->Events

Captured in our Cloud infrastructure and available for ML models processing

Events

Page 5: Demystifying Coveo Machine Learningimpact.coveo.com/.../2017/07/Demystifying-Coveo-Machine-Learning… · Demystifying Coveo Machine Learning. 1. Intelligent Query Suggest 2. Automatic

5 © 2017 Coveo Solutions Inc - Proprietary and Confidential

Page 6: Demystifying Coveo Machine Learningimpact.coveo.com/.../2017/07/Demystifying-Coveo-Machine-Learning… · Demystifying Coveo Machine Learning. 1. Intelligent Query Suggest 2. Automatic
Page 7: Demystifying Coveo Machine Learningimpact.coveo.com/.../2017/07/Demystifying-Coveo-Machine-Learning… · Demystifying Coveo Machine Learning. 1. Intelligent Query Suggest 2. Automatic

7

Machine Learning configuration

Page 8: Demystifying Coveo Machine Learningimpact.coveo.com/.../2017/07/Demystifying-Coveo-Machine-Learning… · Demystifying Coveo Machine Learning. 1. Intelligent Query Suggest 2. Automatic

8 © 2017 Coveo Solutions Inc - Proprietary and Confidential

Recommendations

Page 9: Demystifying Coveo Machine Learningimpact.coveo.com/.../2017/07/Demystifying-Coveo-Machine-Learning… · Demystifying Coveo Machine Learning. 1. Intelligent Query Suggest 2. Automatic

9

IntelligentRecommendations

Page 10: Demystifying Coveo Machine Learningimpact.coveo.com/.../2017/07/Demystifying-Coveo-Machine-Learning… · Demystifying Coveo Machine Learning. 1. Intelligent Query Suggest 2. Automatic

10 © 2017 Coveo Solutions Inc - Proprietary and Confidential

Page 11: Demystifying Coveo Machine Learningimpact.coveo.com/.../2017/07/Demystifying-Coveo-Machine-Learning… · Demystifying Coveo Machine Learning. 1. Intelligent Query Suggest 2. Automatic

11

Page 12: Demystifying Coveo Machine Learningimpact.coveo.com/.../2017/07/Demystifying-Coveo-Machine-Learning… · Demystifying Coveo Machine Learning. 1. Intelligent Query Suggest 2. Automatic

Recommendation

Usage Analytics

ML

Previous Users

Record Users ActionsType: Page View and QueryMandatory: Key/Value (identifies one document in one language)Optional: contentType (to recommend a specific type of document)

Build a model(0..n contentTypes)

Query Pipeline

Index

Current User Recommendation RequestActions History (e.g. page view, query)

RecommendationRequest

Query(@Key = @Value)

Page 13: Demystifying Coveo Machine Learningimpact.coveo.com/.../2017/07/Demystifying-Coveo-Machine-Learning… · Demystifying Coveo Machine Learning. 1. Intelligent Query Suggest 2. Automatic

13 © 2017 Coveo Solutions Inc - Proprietary and Confidential

Query Suggest

Page 14: Demystifying Coveo Machine Learningimpact.coveo.com/.../2017/07/Demystifying-Coveo-Machine-Learning… · Demystifying Coveo Machine Learning. 1. Intelligent Query Suggest 2. Automatic

14 © 2017 Coveo Solutions Inc - Proprietary and Confidential

Page 15: Demystifying Coveo Machine Learningimpact.coveo.com/.../2017/07/Demystifying-Coveo-Machine-Learning… · Demystifying Coveo Machine Learning. 1. Intelligent Query Suggest 2. Automatic

15 © 2017 Coveo Solutions Inc - Proprietary and Confidential

Page 16: Demystifying Coveo Machine Learningimpact.coveo.com/.../2017/07/Demystifying-Coveo-Machine-Learning… · Demystifying Coveo Machine Learning. 1. Intelligent Query Suggest 2. Automatic

16 © 2017 Coveo Solutions Inc - Proprietary and Confidential

Page 17: Demystifying Coveo Machine Learningimpact.coveo.com/.../2017/07/Demystifying-Coveo-Machine-Learning… · Demystifying Coveo Machine Learning. 1. Intelligent Query Suggest 2. Automatic

Model = list of suggestions candidatesPast queries that were successfulScore based on the relevance indexLanguage-specific models

At query timePartial query compared to all candidates using a distance metric

Candidates are ranked based on their distance metrics and their relevance score

Time constrained: compute for a predetermined duration.

Query suggestion

Page 18: Demystifying Coveo Machine Learningimpact.coveo.com/.../2017/07/Demystifying-Coveo-Machine-Learning… · Demystifying Coveo Machine Learning. 1. Intelligent Query Suggest 2. Automatic

18© 2017 Coveo Solutions Inc - Proprietary and Confidential

Page 19: Demystifying Coveo Machine Learningimpact.coveo.com/.../2017/07/Demystifying-Coveo-Machine-Learning… · Demystifying Coveo Machine Learning. 1. Intelligent Query Suggest 2. Automatic

19© 2017 Coveo Solutions Inc - Proprietary and Confidential

Page 20: Demystifying Coveo Machine Learningimpact.coveo.com/.../2017/07/Demystifying-Coveo-Machine-Learning… · Demystifying Coveo Machine Learning. 1. Intelligent Query Suggest 2. Automatic

20 © 2017 Coveo Solutions Inc - Proprietary and Confidential

Automated Relevance Tuning

Page 21: Demystifying Coveo Machine Learningimpact.coveo.com/.../2017/07/Demystifying-Coveo-Machine-Learning… · Demystifying Coveo Machine Learning. 1. Intelligent Query Suggest 2. Automatic

21© 2017 Coveo Solutions Inc - Proprietary and Confidential

Page 22: Demystifying Coveo Machine Learningimpact.coveo.com/.../2017/07/Demystifying-Coveo-Machine-Learning… · Demystifying Coveo Machine Learning. 1. Intelligent Query Suggest 2. Automatic

22 © 2017 Coveo Solutions Inc - Proprietary and Confidential

Page 23: Demystifying Coveo Machine Learningimpact.coveo.com/.../2017/07/Demystifying-Coveo-Machine-Learning… · Demystifying Coveo Machine Learning. 1. Intelligent Query Suggest 2. Automatic

Favors most popular and pertinent documents for each query

Implicit synonyms detection

Understands common typos

Learns from search sessionsLinks each query to all subsequent clicksLearns the relation strengths between query parts and clicks

Automatic parameter optimization

Automated Relevance Tuning

Query

Clicked SearchResult

… QueryLast Clicked

Search Result

Clicked SearchResult

Clicked SearchResult

Clicked SearchResult

Typical Search Visit

Page 24: Demystifying Coveo Machine Learningimpact.coveo.com/.../2017/07/Demystifying-Coveo-Machine-Learning… · Demystifying Coveo Machine Learning. 1. Intelligent Query Suggest 2. Automatic

24 © 2017 Coveo Solutions Inc - Proprietary and Confidential

Intelligent Term Detection

Page 25: Demystifying Coveo Machine Learningimpact.coveo.com/.../2017/07/Demystifying-Coveo-Machine-Learning… · Demystifying Coveo Machine Learning. 1. Intelligent Query Suggest 2. Automatic

Goal is to query the index with long text strings or natural language queriesex: case description

Algorithm extracts the most important terms, using the customer vocabulary frompast queries

Improved relevance over partial match - when enabled automatically boosts documents matching terms

Intelligent Term Detection

Page 26: Demystifying Coveo Machine Learningimpact.coveo.com/.../2017/07/Demystifying-Coveo-Machine-Learning… · Demystifying Coveo Machine Learning. 1. Intelligent Query Suggest 2. Automatic

Intelligent Term Detection

Page 27: Demystifying Coveo Machine Learningimpact.coveo.com/.../2017/07/Demystifying-Coveo-Machine-Learning… · Demystifying Coveo Machine Learning. 1. Intelligent Query Suggest 2. Automatic

27 © 2017 Coveo Solutions Inc - Proprietary and Confidential

Questions?

Page 28: Demystifying Coveo Machine Learningimpact.coveo.com/.../2017/07/Demystifying-Coveo-Machine-Learning… · Demystifying Coveo Machine Learning. 1. Intelligent Query Suggest 2. Automatic

Richard TessierSVP Products

[email protected]

https://www.linkedin.com/in/richardtessier/

28 ©2017CoveoSolutionsInc- ProprietaryandConfidential

Thank you!

Don’t miss tomorrow’s session on Getting the most out of Coveo Machine Learning!