What you need to know about Search in SharePoint 2013 Preview - DFW SharePoint Users Group 2012

42
©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.

description

Slides from my talk about Search in SharePoint 2013 Preview at the Dallas Fort Worth (DFW) SharePoint Users Group

Transcript of What you need to know about Search in SharePoint 2013 Preview - DFW SharePoint Users Group 2012

Page 1: What you need to know about Search in SharePoint 2013 Preview - DFW SharePoint Users Group 2012

©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.

Page 2: What you need to know about Search in SharePoint 2013 Preview - DFW SharePoint Users Group 2012

©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.

What you need to know about Search in SharePoint 2013 PreviewCorey Roth (@coreyroth)Applications ArchitectInfusion

Page 3: What you need to know about Search in SharePoint 2013 Preview - DFW SharePoint Users Group 2012

©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.

Corey RothAbout me

Transplant to Houston, TX Applications Architect at Infusion Development Three-time Microsoft SharePoint MVP Specializing in ECM, Search, and apps Come see my sessions at SPC12

E-mail: [email protected] Twitter: @coreyroth Blog: www.dotnetmafia.com

Page 4: What you need to know about Search in SharePoint 2013 Preview - DFW SharePoint Users Group 2012

©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.

Agenda

Major Product Changes User Interface Crawling Querying SharePoint Online Logical Architecture API (Developer Breakout)

Page 5: What you need to know about Search in SharePoint 2013 Preview - DFW SharePoint Users Group 2012

©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.

Where is FAST Search for SharePoint? GONE!

Components of FS4SP and some FAST ESP fully integrated

Page 6: What you need to know about Search in SharePoint 2013 Preview - DFW SharePoint Users Group 2012

©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.

New Search Interface

Page 7: What you need to know about Search in SharePoint 2013 Preview - DFW SharePoint Users Group 2012

©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.

New Search Interface Script based queries Template based search results Visual Refiners Previews for more documents types using OWA

Page 8: What you need to know about Search in SharePoint 2013 Preview - DFW SharePoint Users Group 2012

©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.

Search Demo

demo Corey Roth

Page 9: What you need to know about Search in SharePoint 2013 Preview - DFW SharePoint Users Group 2012

©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.

Result Types SharePoint 2013includes a new framework for presenting

search results to end users called result types Result types have several elements that enable each

type to be rendered differently:

Page 10: What you need to know about Search in SharePoint 2013 Preview - DFW SharePoint Users Group 2012

©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.

Result Type with Display Template Example Here’s an example from one of the Hands On Labs that

demonstrates building a custom result type and display template for .TXT file search results:

Page 11: What you need to know about Search in SharePoint 2013 Preview - DFW SharePoint Users Group 2012

©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.

Result Types

demo Corey Roth

Page 12: What you need to know about Search in SharePoint 2013 Preview - DFW SharePoint Users Group 2012

©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.

Query Suggestion Examples Here are some examples of how query suggestions

might look: Before the Query Suggestion Above are items based on what other

users have queried and found Bottom 3 items are ones you clicked

before

After the Query Suggestion Top 3 items are ones you clicked before

Page 13: What you need to know about Search in SharePoint 2013 Preview - DFW SharePoint Users Group 2012

©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.

Crawl and Content Configuration

Crawling and Content Sources Result Sources Improvements in Document Parsing Entity Extraction Schema Management

Page 14: What you need to know about Search in SharePoint 2013 Preview - DFW SharePoint Users Group 2012

©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.

Crawling and Content Sources

Crawling improvements Anonymous HTTP crawling Crawls aysnc content Continuos crawling

Page 15: What you need to know about Search in SharePoint 2013 Preview - DFW SharePoint Users Group 2012

©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.

Result Sources – FKA Scopes and Federated Search Scopes and Federated Search in SharePoint 2010 are now known

as “Result Sources” in SharePoint 2013 Results Sources also support a “Remote SharePoint Index”

Page 16: What you need to know about Search in SharePoint 2013 Preview - DFW SharePoint Users Group 2012

©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.

Improvements in Result Sources Site and site collection admins can manage and

configure result source Reduces need for SSA admins to configure Empowers lower-level admins

Exchange result source Allows query transformations

Eg: appendeding to each query, e.g. author=“Our CEO”, etc.

Page 17: What you need to know about Search in SharePoint 2013 Preview - DFW SharePoint Users Group 2012

©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.

Content Sources and Result Sources

demo

Page 18: What you need to know about Search in SharePoint 2013 Preview - DFW SharePoint Users Group 2012

©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.

Improvements in Document Parsing

SharePoint 2013 introduces new parsing features Automatic file format detection: no longer relies on

file extension Deep link extraction for Word and PowerPoint

formats Visual metadata extraction: titles, authors and dates High-performance format handlers for HTML, DOCX,

PPTX, TXT, Image, XML and PDF formats New Montage, Visio and OneNote filters The IFilter API still around

Page 19: What you need to know about Search in SharePoint 2013 Preview - DFW SharePoint Users Group 2012

©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.

Summary: New Site Search Admin Tasks Just to summarize, here are things site admins can do to

manage search themselves:Task Site

Collection Admin

Site Admin

Create and/or override Query Rules, including Promoted Results

Create and/or override Result types and display templates

Create and/or override Result Sources, either for remote locations or as a custom search “vertical”

Create managed properties

Create refiners

Start a local crawl – can even be done down to the list level

Page 20: What you need to know about Search in SharePoint 2013 Preview - DFW SharePoint Users Group 2012

©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.

Schema Management Managed properties still configured at SSA level Site Collection admins can define managed properties

Site collection admins can pick up new crawled properties for custom metadata in their sites and create managed properties from them

Still requires a full crawl SSA Properties used by default until overridden

Page 21: What you need to know about Search in SharePoint 2013 Preview - DFW SharePoint Users Group 2012

©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.

Faceted Navigation with Search Refiners Uses term sets for navigations Associate terms to managed properties Managed property must be set as “Refinable” Example:

You have term store terms Camera and Laptop You have managed properties Megapixel Count, Color and

Manufacturer For Camera term, you add refiners for Megapixel Count and

Manufacturer For Laptop term you add refiners for Color and Manufacturer

Another Example: Department is the term store term, Customers and Projects

could be refiners

Page 22: What you need to know about Search in SharePoint 2013 Preview - DFW SharePoint Users Group 2012

©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.

New Search Settings

demo

Page 23: What you need to know about Search in SharePoint 2013 Preview - DFW SharePoint Users Group 2012

©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.

SharePoint Online SPO gets some love

Greater feature parity with on-premises Tenant admin has search settings

i.e.: Search Schema, Results Sources, Query Suggestions, Authoritive Pages

Automatic OWA

Page 24: What you need to know about Search in SharePoint 2013 Preview - DFW SharePoint Users Group 2012

©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.

SharePoint Online

demo

Page 25: What you need to know about Search in SharePoint 2013 Preview - DFW SharePoint Users Group 2012

©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.

Architecture

Logical Architecture - Components Crawl Content Processing Analytics Processing Index Administration Query Processing

Search Process

Page 26: What you need to know about Search in SharePoint 2013 Preview - DFW SharePoint Users Group 2012

©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.

Logical Architecture

Page 27: What you need to know about Search in SharePoint 2013 Preview - DFW SharePoint Users Group 2012

©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.

Crawling the Content• Crawls SharePoint Content• Crawl database tracks content that is

crawled• Does not store the crawled content

Page 28: What you need to know about Search in SharePoint 2013 Preview - DFW SharePoint Users Group 2012

©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.

Content Processing Content Processing Component

Processes crawled items and feeds these items to the index component

Document Parsing happens through Format Handlers iFilter is supported through a Generic iFilter format handler iFilters are still the extensibility platform for SharePoint 15

Heart of indexing process Linguistic Processing Writes to link database Generates phonetic name variations for people search

Page 29: What you need to know about Search in SharePoint 2013 Preview - DFW SharePoint Users Group 2012

©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.

Analytics Processing Component Analyzes crawled items and how users interact

with search results.

Page 30: What you need to know about Search in SharePoint 2013 Preview - DFW SharePoint Users Group 2012

©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.

Index Component

Used in both feeding and query processes: Feeding: receives processed items from the

content processing component and writes those items to index files

Query: receives queries from the query processing component and returns results sets

Page 31: What you need to know about Search in SharePoint 2013 Preview - DFW SharePoint Users Group 2012

©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.

Index Architecture (at very high level) An index partition is a logical

portion of the entire search index.

Index can scale in both horizontal (partitions) and vertical (replicas) ways

Partitions can be added but NOT removed

PrimaryReplica

SecondaryReplica 1

SecondaryReplica 2

Secondary Replica 1

SecondaryReplica 2

Primary Replica

Secondary Replica 3

SecondaryReplica 2

Primary Replica

SecondaryReplica 1

Partition #1 Partition #2 Partition #3

SecondaryReplica 3

SecondaryReplica 3

Servers

Index Servers1, 2 & 3

Index Servers4, 5 & 6

Index Servers7, 8 & 9

Index Servers10, 11 & 12

Page 32: What you need to know about Search in SharePoint 2013 Preview - DFW SharePoint Users Group 2012

©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.

Query Processing Component

Performs linguistic processing at query time: Word breaking, stemming, query spellchecking, thesaurus

Analyzes and processes search queries and results.

Page 33: What you need to know about Search in SharePoint 2013 Preview - DFW SharePoint Users Group 2012

©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.

Search Administration Search Admin Component

Runs number of system processes required for search

Responsible for search provisioning and topology changes

Coordinates search components – Content Processing, Query Processing, Analytics, and Indexing.

Search Admin DB Stores search configuration data:

Topology Crawl rules Query rules Managed property mappings Content sources Crawl schedules

Stores Analytics settings

Page 34: What you need to know about Search in SharePoint 2013 Preview - DFW SharePoint Users Group 2012

©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.

Search Processes Host Controller

Windows Service that supervises NodeRunner process(es) Automatically restarts NodeRunner.exe

NodeRunner.exe Process that hosts a search components Five instances total (one per component)

Can be scaled to multiple servers

MSSearch.exe Windows Service hosting the Crawl Component

Page 35: What you need to know about Search in SharePoint 2013 Preview - DFW SharePoint Users Group 2012

©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.

Search Host Process Multiple NodeRunner instances can

run on the same server Each NodeRunner instance hosts one

search component 5 instances of the NodeRunner.exe on

a single server install

NodeRunner.exe

Crawl Component

NodeRunner.exe

Query Processing Component

NodeRunner.exe

Analytic Processing Component

NodeRunner.exe

Content Processing Component

NodeRunner.exe

Index Component

Page 36: What you need to know about Search in SharePoint 2013 Preview - DFW SharePoint Users Group 2012

©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.

Architecture Demo

demo Corey Roth (@coreyroth)Applications ArchitectInfusioin

Page 37: What you need to know about Search in SharePoint 2013 Preview - DFW SharePoint Users Group 2012

©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.

API Changes REST Client Object Model Web Services Deprecated

Page 38: What you need to know about Search in SharePoint 2013 Preview - DFW SharePoint Users Group 2012

©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.

Query Languages Keyword Query Syntax

Preferred Method FAST Query Language (FQL)

Still available Full Text SQL Query

Removed from product

Page 39: What you need to know about Search in SharePoint 2013 Preview - DFW SharePoint Users Group 2012

©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.

Querying with REST Available at the URL http://server/_api/search/query

Pass keyword query via querytext parameter

Page 40: What you need to know about Search in SharePoint 2013 Preview - DFW SharePoint Users Group 2012

©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.

Querying wit REST

demo

Page 41: What you need to know about Search in SharePoint 2013 Preview - DFW SharePoint Users Group 2012

©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.

Search Client Object Model Microsoft.SharePoint.Client.Search.dll Execute queries with SearchExecutor class

Page 42: What you need to know about Search in SharePoint 2013 Preview - DFW SharePoint Users Group 2012

©2012 Microsoft Corporation. All rights reserved. Content based on SharePoint 15 Technical Preview and published July 2012.

Querying with CSOM

demo