Data Scraping with Mozenda

A modern tale

delivered by

Cap’n Mike Veitch

Even pirates

are now on

a database

Enter Name

Search

Pirate Locator

Current Ship

Enter Name

Search

Jack Sparrow

Current Ship

Pirate Locator

Enter Name

Clear

Jack Sparrow Black Pearl

Current Ship

Pirate Locator

Enter Name

Search

Current Ship

Pirate Locator

Enter Name

Search

Davy Jones

Current Ship

Pirate Locator

Enter Name

Clear

Davy Jones Flying Dutchman

Current Ship

Pirate Locator

Ok to find a few locations


If we knew all the pirates?



Getting 10…



Getting 10… 100…



Getting 10… 100… 1000…



Getting 10… 100… 1000…

We need automation

Enter Name

Search

Pirate Locator

Current Ship

Enter Name

Search

Pirate Locator

Current Ship

Fill in the search box

Cap’n Veitch

Enter Name

Search

Pirate Locator

Current Ship

Press the button

Cap’n Veitch

Enter Name

Search

Pirate Locator

Current Ship

Copy the response

Cap’n Veitch On Shore Leave

Enter Name

Search

Pirate Locator

Current Ship

1

2 3

Repeat this process for a list of pirates

Automation Solutions


browser cut and paste (lots of)



Browser based software (Javascript)




Server based software (PHP, perl etc)




Server based software (PHP, perl etc)

SaaS - Software as a Service company

A simple question

How many Brava members

are in each ward in Brent?

7

2

19

20

9

1017

18

14

3

10 174

6

6

22 17

6

4 5

33

Distribution of BRAVA Membersin London Borough of Brent

How is done?

How is done?

Who the Brava members are

How is done?


The address of each member

How is done?



The mapping of address to ward

How is done?



The mapping of address to ward

Count members in each ward

276 Organisations

Loop through a list of postcodes

276 Organisations in Brent

276 Organisations in Brent

What happened to the other 27?

7

2

19

20

9

1017

18

14

3

10 174

6

6

22 17

6

4 5

33

Distribution of BRAVA Membersin London Borough of Brent

Documents