ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler...

33
ORGANIC SEARCH
  • date post

    19-Dec-2015
  • Category

    Documents

  • view

    217
  • download

    1

Transcript of ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler...

Page 1: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers.

ORGANIC SEARCH

Page 2: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers.

CRAWL

INDEX

RANK

Page 3: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers.

CRAWLING

KnownWeb

pages

Index Servers

CrawlerMachines

Googlebot

Doc Servers

Page 4: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers.

DEVELOPING THE LIST OF KNOWN WEB PAGES

KnownWeb

pages

Prior Crawls

/addurl

Page 5: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers.

PEREMECH

Page 6: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers.

CRAWLING FOR PEREMECH

usm.maine.edu/index.html

/academic/index.html

/sb/index.html

/sb/facultystaff.html

/sb/zsuleiman.html

/~suleiman/index.html

/~suleiman/peremech/index.html

other linked pages

other linked pages

other linked pages

Page 7: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers.

CRAWLERS IDENTIFY THEMSELVES

Page 8: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers.

ROBOTS.TXT – EXCLUDES SITES FROM CRAWLING

whitehouse.gov/robots.txt

Page 9: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers.

CRAWLERS SHOULD NOT HOG RESOURCES

Page 10: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers.

CRAWLING PROBLEM: THE WEB IS VAST

Page 11: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers.

CRAWLING PROBLEM: THE HIDDEN WEB

Page 12: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers.

INDEXING

Page 13: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers.

RANKING

Closely guarded, proprietary algorithm

Page 14: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers.

RANKING

Organic Search Results

Keyword Phrase

Page 15: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers.

RANKING – THINGS THAT MATTER

Can you find the word Lobster?

Page 16: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers.

WHY IS RED LOBSTER RANKED HIGHER?

Can you find the word Lobster?

Page 17: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers.

HOW CAN I IMPROVE MY RANK?

Page 18: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers.

BASIC SEO CONCEPTS –TEXT

KEYWORD PROXIMITY

We sell live Maine lobster

Home of Maine’s best lobster

All of our lobsters come from Maine

Page 19: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers.

BASIC SEO CONCEPTS –TEXT

KEYWORD DENSITY

What percentage of the words on this page are lobster.

Page 20: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers.

BASIC SEO CONCEPTS –TEXT

KEYWORD FREQUENCY

The keyword lobster is visible 32 times and occurs 182 times on the page

Page 21: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers.

BASIC SEO CONCEPTS –TEXT

KEYWORD PROMINENCE

LobsterLobster

Lobster

Lobster

Lobster

Lobster

Page 22: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers.

BASIC SEO CONCEPTS – LINKING

LINK EXCHANGE AND PAID PLACEMENT

Page 23: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers.

BASIC SEO CONCEPTS – LINKING

An article written at thefreelibrary.com

Page 24: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers.

BASIC SEO CONCEPTS – LINKING

PAID PLACEMENT

Page 25: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers.

BASIC SEO CONCEPTS – LINKING

LINK EXCHANGE - RELEVANT

Page 26: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers.

BASIC SEO CONCEPTS – LINKING

LINK EXCHANGE – NON RELEVANT

Page 27: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers.

BASIC SEO CONCEPTS – LINKING

LINK SPAM

Page 28: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers.

BASIC SEO CONCEPTS – LINKING

COMMENT/ FORUM SPAM

Page 29: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers.

BASIC SEO CONCEPTS – LINKING

COMMENT/ FORUM SPAM

Page 30: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers.

LINK EXCHANGE IS CONTROVERSIAL

Page 31: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers.

USER RELEVANCE

LOCATION

USER ID

130.111.115.24

Page 32: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers.

USER EXPERTISE VARIES

Page 33: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers.

PHOTO ATTRIBUTIONS

Slide 10: 'OINK! OINK!’ www.flickr.com/photos/49968232@N00/51679641

Slide 11: ‘The Vast Web’ wikicommons.com

Slide 13: 'Royal Guards’ www.flickr.com/photos/23697065@N05/2356109302

Slide 17: 'Yoda (IMG_3308)‘ www.flickr.com/photos/73531322@N00/194828922

Slide 30: ‘Vera Cruz’ BAM/Photofest