User Guide For Scraper Pro Basic and Basic Scrapper Pro ... · 1 User Guide For Scraper Pro Basic...

Post on 04-Oct-2020

11 views 0 download

Transcript of User Guide For Scraper Pro Basic and Basic Scrapper Pro ... · 1 User Guide For Scraper Pro Basic...

1

User Guide For Scraper Pro Basic and Basic Scrapper Pro Basic and Gold

Scrapper Pro Basic and Premium Version 3

Brought to you by www.ScraperPro.com & www.Easy1Up.com

2

Welcome to the Scraper Pro overview manual. This will be mostly screen shots because it is an amazingly simply piece of software. What Scraper Pro does is

streamline the search process.

Scraper Pro does not hack into any site. You simply type in keywords that you’d like to search for and what sites you’d like the software to go into and press start. It’s that simple.

Screen Shot of Application and Description:

There are 3 versions of Scraper Pro. Basic, Gold & Premium

The basic version will search through Google, Alta Vista, Yahoo and Bing while the Gold & Premium versions go into the above sites as well as… 1) lycos.com 2) excite.com 3) ask.com 4) gigablast.com 5) webcrawler.com 6) dogpile.com 7) snap.com 8) thomasnet.com 9) kellysearch.com 10) globalspec.com Premium Sites: 1) SuperPages.com 2) YellowPages.com 3) ServiceMagic.com 4) CraigsList.com 5) AdLandPro.com 6) MSN.com 7) BackPage.com 8) usfreeads.com 9) kijiji.com

3

Let’s look at Scraper Pro Basic first. All versions work virtually the same but the Gold version has many more options, filters and sites to search. This is the basic screen you will see when you launch. The first thing you should do is to click on the settings ICON to set up the software.

4

Settings Section Network: Here User Select proxy file to use proxy in application. You would use this if you want to search anonymously. You will have to buy the proxy lists from applicable vendors on the internet.

Search Engine Tab Here user can select search engine sites: You can select any or all sites available. Then select OK to save.

5

Search Options Tab Maximum Search Depth: The most you can enter here is 9 which is how many pages deep it can search. This depends on the site as well. Maximum Extracted results is only applicable to trial version

6

Others: Here User Select if Scraper Pro will pull whatever phone, fax or email combination you want.

7

Once you enter your keyword you can start the search. As the results start to come up, you can export the results to a CSV file format.

8

You can also use the Start from specific URL Tab which is in the middle of the screen. Should you decide that you need to log in, you can do so and the middle part of the software will show the site to log into.

9

Scraper Pro Gold The Gold version also has many additional functions to it as well. So let’s go into the Gold version and show you its functions.

This is the basic screen you will see. Here user can input keyword and click on start button. However before you do that you should click on the setting icon.

10

Settings Section Search Engine Tab Here user can select search engine sites You can select any or all sites available. Then select OK to save. Pressmania.com and servicemagic.com may not provide accurate results.

11

Search Options Tab Maximum Search Depth: The most you can enter here is 9 which is how many pages deep it can search. This depends on the site as well. Filter URL/ Add URL: Here you can enter the type of URL extension of sites that you do not want to search for such as .gov, .edu, .mp3 etc

12

Others: Here User Select Filter domains and select state and if Scraper Pro will pull whatever phone, fax or email combination you want. You can also select the filters that you DO NOT want to search for that you entered in the search options.

13

Network: Here User Select proxy file to use proxy in application. You would use this if you want to search anonymously. You will have to buy the proxy lists from applicable vendors on the internet.

14

On the main application, while searching, you may get records that have multiple emails on one record. If you highlight the record and click on the View Email tab you can then view all the emails for that record. Click on email and email address display in new tab view emails here. View Emails Here … Here user can see email address.

15

After getting results user can export results in csv file.

You can name of output file and click on save button Starting from a specific URL If you want data from some url, you then enter url where it says “Please enter start URL” and click on start. You, also have the option of selection on not selecting the check boxes below. If you need to log into the site before starting the search then you can log in and the screen on Scraper Pro will change to show the site. Then once you log in, you can start your search.

Searching by Directories

16

You may want to look in specific states for Lawyers, dentists, real estate etc. No problem. Here is what to do. Log in and click on the settings ICON. Then go to the Search Engine Tab. Unselect all search engines by unchecking the Select All box. Then check off the directory sites you want. Most will choose Super Pages and Yellow Pages.

Then go to the Others Tab and uncheck the Select all box there too. You will unselect all stats. Then check off the state or states that you want to look in. Once done, select OK to save.

17

Then go to the main screen and type in the search term you would like to look at like lawyers, dentists etc. In the screen shot below, I types in the word lawyer. Once done, select file > save and you are all set.

18

If you want more specific searches, you can type in the city such as lawyer, San Diego and you will get a more specific search.

19

Screen Shot for How to get details based on Search keyword + Subject line (i.e

intitle: amit)

20

In Title Function

1) First you have to select “Use Subject Line” option.

2) Once you select this option you will get list of Subject Lines.

3) By selecting any of subject line and inserting keyword you will get result based on

combination of these two.

Here are some interesting articles:

http://www.googletutor.com/using-the-intitle-operator-in-search/

http://www.googleguide.com/advanced_operators.html

allintitle: Search for documents with the given words in their title. allintitle:doughnuts chocolate

will find all the documents with title containing „doughnuts‟ and „chocolate‟.

21

intitle:

Search for documents with the first word after the intitle operator in their title.

intitle:doughnuts chocolate will find all the documents with title containing „doughnuts‟

and talking about chocolate. Note that the word „chocolate‟ is not necessarily in the title.

allintext:

Search for documents with the given words in their text. allintext:doughnuts chocolate

will find all the documents with text containing „doughnuts‟ and „chocolate‟.

intext:

Search for documents with the first word after the intext operator in their text.

intext:doughnuts chocolate will find all the documents with text containing „doughnuts‟

and talking about chocolate. Note that the word „chocolate‟ is not necessarily in the text

allinurl:

Search for documents with the given words in their url. allinurl:doughnuts chocolate will

find all the documents with url containing „doughnuts‟ and „chocolate‟.

inurl:

Search for documents with the first word after the inurl operator in their url.

inurl:doughnuts chocolate will find all the documents with url containing „doughnuts‟

and talking about chocolate. Note that the word „chocolate‟ is not necessarily in the text

allinanchor:

Search for documents with the given words in an anchor. allinurl:doughnuts chocolate

will find all the documents with anchor text containing „doughnuts‟ and „chocolate‟.

inanchor: Search for documents with the first word after the operator in an anchor.

inanchor:doughnuts chocolate will find all the documents with anchor containing

„doughnuts‟ and talking about chocolate. Note that the word „chocolate‟ is not

necessarily in an anchor.

Detailed Screenshots of sites

Note. These may vary and not all data can be found on every site.

1) Site: http://www.superpages.com/

URL: - http://www.superpages.com/

22

Here you have to enter Business name, Category or Keyword and Enter City,

State or Zip.

Then Click on Search Button.

URL: http://yellowpages.superpages.com/listings.jsp?CS=L&MCBP=true&C=Restaurants&

STYPE=S&L=USA&search.x=0&search.y=0&search=Find+It&search=Find+It

23

From this Screen, We will scrape Site URL, Title, Phone no, Fax.

2) Site: http://www.yellowpages.com

URL: http://www.yellowpages.com

24

Here you have to enter Business name or Category or Location (City, State,

Zipcode or Neighborhood).

Then Click on Find Button.

25

URL: http://www.yellowpages.com.nyud.net/mc/New-York-NY/Internet-Marketing-

Advertising--Marketing-Consultants?search_terms=Marketing+companies

From this Screen, We will scrape Site URL, Title, Phone no, Email.

3) Site: http://www.craigslist.org

URL: http://www.craigslist.org/about/sites

26

This is the main page. Here we need to go through city wise. We click on “Atlanta” city.

URL: http://atlanta.craigslist.org/

27

Here on this page you will be able to see all categories.

28

URL: http://atlanta.craigslist.org/act/

Here Enter keyword and click on Search button.

URL: http://atlanta.craigslist.org/search/act?query=education&catAbbreviation=act

29

Click on the links one by one.

URL: http://atlanta.craigslist.org/nat/act/1395520008.html

30

From this Screen, We will scrape Title.

31

From this Screen, We will scrape Site URL, Phone no, Fax, Email.

4) Site: http://www.servicemagic.com/

*service magic tends to not pull accurate results. Test it on your own and feel free to use

it. URL: http://www.servicemagic.com/

32

In this page, Click on Contractor Directory.

URL: http://www.servicemagic.com/c.html

*service magic tends to not pull accurate results. Test it on your own and feel free to use

it.

33

Here click on all categories one by one.

URL: http://www.servicemagic.com/emc.Additions-Remodeling-directory.-12001.html

34

Here click on all states one by one.

URL: http://www.servicemagic.com/emc.Alaska.Additions-Remodeling-directory.-

12001.html

35

From this Screen, We will scrape Site URL, Title, Phone no.

5) Site: http://adlandpro.com/

URL: http://adlandpro.com/

36

In this Screen, Select all cities one by one.

Pressmania.com

*Pressmania tends to not pull accurate results. Test it on your own and feel free to use it.

URL: http://atlanta.pressmania.com/

37

In this Screen, Click on all these links one by one.

URL: http://atlanta.pressmania.com/all/234/ads.aspx

38

In this Screen, Click on all these links one by one.

URL: http://atlanta.pressmania.com/all/234/ads.aspx

39

From this Screen, We will scrape Site URL, Title, Phone no.

40

Summary:

Start button will start to scrap data from sites selected in setting form.

If user wants to filter than from main page user can checked on use filter and

input keyword and for url filter user can select domain in “other” tab in

setting form.

If multiple email is available than user can view email in individual column

than user can click on email and view all emails in “view Emails” tab

Stop button will abort current process.

Exit button will close this application.

Home button will open Scrapper Pro site.

Clicking on Setting button, one setting form will open.

In which you have to select sites and states and other proxy related settings.

To export scrapped results Click on file->save option.

“Results” is showing total Records scrapped.