Mobile Coverage Report Loddon Mallee Overview Final Mallee Overview Report Mobile Phone and Device...

Digital Economy Group Pty Ltd

ABN 48 153 285 191

P.O. Box 1191

Nambour, Queensland 4560

Regional Development Australia - Loddon Mallee

Mobile Phone and Device Blackspots

Connectivity Assessment for the Loddon

Mallee Region

Overview Report

3 November 2014

Strategy, Planning & Development Implementation Programs

Research, Analysis & Measurement Mobile Coverage Testing

Digital Mapping

Loddon Mallee Overview Report

Mobile Phone and Device

Blackspots Connectivity

Assessment for the Loddon

Mallee Region


ABN 48 153 285 191

P.O. Box 1191

Nambour, Queensland 4560

Document History

Version Author Amendments Date

V1.0 Megan Whereat Initial Draft 9 August 2014

V1.1 Michael Whereat Working Draft 5 September 2014

V1.2 Michael Whereat Final Draft 26 September 2014

V1.3 Michael Whereat Final including feedback 3 November 2014

Distribution List

Person Title

Project Steering Group

Michael Whereat Director, Digital Economy Group

Megan Whereat Business Manager, Digital Economy Group

Markeeta Culley Project Officer, Digital Economy Group

Disclaimer:

Information in this document is based on available data at the time of writing this document.

Digital Economy Group Pty Ltd or its officers accept no responsibility for any loss occasioned to

any person acting or refraining from acting in reliance upon any material contained in this

document.

Copyright

© Digital Economy Group 2014.

This document is copyright and must be used except as permitted below or under the Copyright

Act 1968. You may reproduce and publish this document in whole or in part for you and your

organisation’s own personal and internal compliance, educational or non-commercial purposes.

You must not reproduce or publish this document for commercial gain without the prior written

consent of the Digital Economy Group Pty. Ltd.

Loddon Mallee

Overview Report




Mallee Region


ABN 48 153 285 191

Commercial In Confidence i | P a g e

Contents

1. Executive Summary 1 2. Introduction 3 3. Methodology 4 3.1. The Study Area 4 3.2. Current Carrier Coverage 4 3.3 Current Carrier Sites and ACMA Licences overview 5 3.4 Carrier Baseline 7 3.5 Testing Methodology 8 3.5.1 Network Performance Tests 8 3.5.2 Network Performance Time Series Testing 9 3.5.3 Testing Equipment and Presentation Limitations 9 4. Mobile Coverage Survey Results 10 5 Mobile Coverage Testing Results 12 5.1 Introduction 12 5.2 Tested Routes 13 5.3 Voice and 3G Blackspots 14 5.4 4G LTE Blackspots 15 5.5 Network Site Test locations and assessment overview 18 5.6 Network Performance Time Series Tests 20 5 Regional Priorities 22 6 Conclusion 23 Attachment 1: Current Carrier Infrastructure 24 Attachment 2: Vodafone Announcement Regarding Roaming Agreement with Optus 28 Attachment 3: Survey Question Results in Graph Format 29 Attachment 4: Network Performance Test Results by Carrier 31 Attachment 5: Loddon Mallee Mobile Coverage Programme Draft Short List 34

Table of Figures Figure 1: Benchmark Location Brisbane CBD – Time Series Testing ....................................................... 9

Figure 2: Signal Strength – Rural Town (left) & – Town Centre (right) ................................................. 12

Figure 3: Signal Strength – Colour Ranges and Settings ....................................................................... 13

Table of Maps Map 1: Study Area .................................................................................................................................. 4

Map 2: Telstra Mobile Phone and Broadband Coverage Loddon Mallee Region as at 5 October 2014 5

Map 3: Current Mobile Carrier Sites – Loddon Mallee ........................................................................... 6

Map 4: Survey Blackspot Locations to 20 September 2014 ................................................................. 10

Map 5: Routes used for Voice & 3G testing .......................................................................................... 13

Map 6: Routes used for 4G LTE testing ................................................................................................. 14

Map 7: Loddon Mallee 4G LTE Blackspots ............................................................................................ 17

Map 8: Network Performance Test Locations for all of Loddon Mallee (using Telstra results) ........... 18

Map 9: Network Performance Time Series Test Locations for all of Loddon Mallee ........................... 21

Tables Table 1: Overview of test statistics for the Loddon Mallee Region ........................................................ 2

Table 2: Carrier Sites and Spectrum Licences Overview - Loddon Mallee .............................................. 7

Table 3: Network Performance Test Scores ............................................................................................ 8

Loddon Mallee

Overview Report




Mallee Region


ABN 48 153 285 191

Commercial In Confidence ii | P a g e

Table 4: Digital Divide and Location Comparison ................................................................................. 12

Table 3: 3G & Voice distance and total number of tests for all 3 Carriers. .......................................... 14

Table 5: Summary of Voice and 3G Blackspots ..................................................................................... 15

Table 6: Summary of 4G Blackspots for the whole of the Loddon Mallee ........................................... 16

Table 8: Consolidated Network Performance Test Scores - Telstra ..................................................... 19

Table 9: Consolidated Network Performance Test Scores - Optus ....................................................... 19

Table 10: Consolidated Network Performance Test Scores - Vodafone ............................................... 20

Loddon Mallee

Overview Report




Mallee Region


ABN 48 153 285 191

Commercial In Confidence 1 | P a g e

1. Executive Summary Mobile connectivity, for phone calls and broadband, has become a utility expected by business,

residents and the community. The rapid development of new technologies and faster connection

options has resulted in regional and rural areas of Australia being on the wrong side of the ‘Digital

Divide’. In our capital cities there are virtually no blackspots for coverage and rapid deployment of

the latest generation of connectivity. On the other side of the ‘Digital Divide’ blackspots form the

largest part of the landscape and their townships have technology a generation or two behind.

For the Loddon Mallee Region and its 10 Local Government areas, the challenge is to find ways to

partner with the three privately owned carriers to reduce the extent of blackspot coverage and

increase access to quality internet data transfer speeds. They must seek to drive expanded and

advanced deployment of the best generation technology the carriers are prepared to invest in.

Managing the region in times of disaster or emergency, providing a positive experience for visitors

and delivering greater productivity for businesses is now a constant requirement for successful local

government areas.

Regional Development Australia (RDA) Loddon Mallee has engaged the Digital Economy Group (DEG)

to benchmark carrier performance and identify priorities to reduce blackspots and improve coverage

across the region. This is the overview report for the whole region and draws the key finding of all 10

individual reports together and guides the regional priorities.

This report contains the following three elements:

identify the Voice and 3G blackspots and sample 4G LTE in selected locations,

test the network performance to identify where network upgrades are required

list the priority locations and short list for Council and the region to pursue

A total of approximately 4,716klms of roads were driven across the entire Loddon Mallee Region. A

total of 559 individual Network Performance Tests were also completed to test the validity of the

coverage maps and confirm that the signal strength maps translated into actual connectivity. A total

of 50 Time Series Network Performance Tests were performed to illustrate the quality of each

respective network and associated reliability. The breakdown for each local government area can be

seen in the Table below.

Loddon Mallee

Overview Report




Mallee Region


ABN 48 153 285 191


Table 1: Overview of test statistics for the Loddon Mallee Region

Local Government 3G & Voice 4G LTE

Network

Tests

Time Series

Tests

Buloke 588 0 56 5

Campaspe 394 23.3 59 5

Central Goldfields 310 0 51 5

Gannawarra 415 0 61 5

Greater Bendigo 413 30.3 49 5

Loddon 499 0 45 5

Macedon Ranges 526 56.2 61 5

Mount Alexander 379 69.72 61 5

Mildura 666 19.9 59 5

Swan Hill 526 41.5 57 5

Total

4,716Klms 241Klms 559 50

The Priorities and Actions for the Loddon Mallee Region are:

The key regional priorities for the Loddon Mallee Region and individual councils are to:

� Short list the priorities in each of the 10 individual local government reports to the top 1 or 2

locations/ outcomes

� Build relationships with the Carriers using these reports and in partnership, identify the locations

where carriers are prepared to build new sites, upgrade existing sites and deploy new spectrum.

This can deliver reduced blackspots, improved coverage, competition and capacity

� To actively pursue the Commonwealth Government’s forthcoming Mobile Coverage Programme

as a way to increase coverage beyond current carrier investment plans. Where possible also

leverage off the new NBN Co Fixed Wireless builds where there is a value add

� Look for ways individually or collectively to share impartial information for the benefit of

consumers and business to:

consider which carrier to use

the best handsets to use (for their location)

technology that is available to amplify signals the whole of life cycle cost of using

alternatives to their current practice

Loddon Mallee

Overview Report




Mallee Region


ABN 48 153 285 191


2. Introduction Mobile phone and broadband services continue to be the major growth area of the Australian

telecommunications market. Mobile use of the internet for business and personal use is a major

influence in this growth.

At the time Australia’s population had reached 22.8 million (30 June 20111) there were 29.28 million

mobile services (voice and data). Telstra reported recently that 4G data use for Australians was

doubling every 4 months and the number of 4G customers had doubled in 6 months.

This is significant for all areas of Australia as the rapid growth is forecast to continue creating a

digital divide for those areas where mobile connectivity is reduced or compromised compared with

the capital cities.

The RDA Loddon Mallee has engaged the Digital Economy Group to complete a Mobile Phone and

Device Blackspots Connectivity Assessment for the Loddon Mallee Region. This includes the

preparation of individual reports for 10 local governments:

Buloke Shire Council

Campaspe Shire Council

Central Goldfields Shire Council

Gannawarra Shire Council

City of Greater Bendigo

Loddon Shire Council

Macedon Ranges Shire Council

Mount Alexander Shire Council

Rural City of Mildura

Swan Hill Shire Council

It is intended that this report be read as a companion document to all ten individual reports.

1 Australian Bureau of Statistics, 2006 Census.

Loddon Mallee

Overview Report




Mallee Region


ABN 48 153 285 191


3. Methodology The methodology used by DEG for independent Mobile Coverage Testing (MCT) has been developed

over four years of ground proofing and evolving discussions with carriers. The methodology follows

six steps:

1. establish the study area

2. capturing current carrier coverage maps

3. create carrier infrastructure maps showing active sites

4. identifying testing routes and site test locations

5. completing the three selected core testing methods:

5.1. signal strength

5.2. network performance and

5.3. time series network performance

6. establish carrier blackspot and determine priority network upgrades

7. providing a localised implementation plan

3.1. The Study Area The study area for the whole project is the RDA Loddon Mallee area including all 10 local

governments.

Map 1: Study Area

Source: RDA Loddon Mallee

3.2. Current Carrier Coverage Each of the three current active carriers publish indicative mobile broadband coverage maps on their

respective websites2 3 4. Carrier coverage maps are updated and modified from time to time. The

2 http://www.telstra.com.au/mobile-phones/coverage-networks/our-coverage/mobile-broadband/

3 http://www.vodafone.com.au/aboutvodafone/network/checker

4 https://www.optus.com.au/network/mobile/coverage

Loddon Mallee

Overview Report




Mallee Region


ABN 48 153 285 191


capture of this information allows DEG to establish the baseline coverage for each carrier in each of

the 10 individual local government areas. These maps will allow the reader to compare current

advertised coverage for each of the carriers as it relates to their own localities. This baseline

information is a key reference point for expectations relating to the service levels of each of the

carriers.

Note: Each of the carriers provides detailed caveats regarding the propagation characteristics of networks and

mobile broadband. Current versions of these considerations can be found on the relevant carrier websites as it

changes from time to time.

Map 2: Telstra Mobile Phone and Broadband Coverage Loddon Mallee Region as at 5 October 2014

Sourced: http://www.telstra.com.au/mobile-phones/coverage-networks/our-coverage/ 5 October 2014

3.3 Current Carrier Sites and ACMA Licences overview All carrier radio licences in Australia are registered and managed by the Australian Communications

Media Authority (ACMA). The following map for all 10 local governments in the Loddon Mallee

Region shows all current active radio licences for Telstra, Optus, Vodafone and NBN Co. See

Attachment 1 for Maps showing each of their four carrier sites separately. Carriers use different

spectrum and technologies to deliver connectivity for mobile phone calls and mobile internet. There

is no consistent radius from a site nor can it be expected that every site will generate 360 degree

coverage. Local topography and vegetation has a big impact on the ability of a device to secure a

signal. Likewise, using a phone or internet connected device indoors can significantly reduce the user

experience.

Loddon Mallee

Overview Report




Mallee Region


ABN 48 153 285 191


NBN Co has been set with the challenge to deploy approx. 2,400 sites by mid-2015. NBN Co has

appointed Ericsson on a $1Billion plus contract. Many of the 2,400 sites required will have to be new

sites (particularly in regional and rural areas), as the existing three carriers have not extended their

reach to many of these areas.

Some sites are colocation (using existing radio transmission sites) with the balance being Greenfield

sites in new areas, potentially providing future mobile network expansion with reduced cost and

timeframe. Vodafone entered into a multiyear agreement with Optus (replacing a previous

agreement with Telstra) to access their network in regional areas from July 1 2013. This allows for

Vodafone users to access the ‘Vodafone’ network even where they do not have their own network

(See Attachment 2 for a copy of the Vodafone Media release).

Map 3: Current Mobile Carrier Sites – Loddon Mallee

Source: ACMA Carrier Locations (Telstra, Optus, Vodafone & NBN Co) at 30 June 2014, Google Earth

2014, Victorian Local Government Boundaries & DEG interpretation.

Loddon Mallee

Overview Report




Mallee Region


ABN 48 153 285 191


3.4 Carrier Baseline The carrier baseline developed below uses the most recent release of ACMA data (capturing licence

information up to the 30th June 2014). The full database contains over 30 columns of information

and many thousands of licences for all radio frequency licences in Australia. This has been filtered to

ensure only the Telstra, Optus and Vodafone radio licence information is used. This is further filtered

to remove satellite earth receive and send sites, navigation and aeronautical equipment maintained

by these companies.

Mobile broadband networks have two key components. The first is the transmission network, which

sends and receives data signals to the site and the second is the local access network – from the user

to the tower. The transmission network can be connected to a tower in two ways – either directly by

optic fibre or by wireless microwave. Carriers prefer to have optic fibre connectivity for all sites,

however, the microwave wireless network is more cost efficient to deploy to distant sites or in

locations with relatively small data transfers. In rural areas it is more common to have microwave

connectivity.

The transmission network usually consists of two types of set up. Point to point and point to multi

point. Locations set up as point to point only are retransmission sites. They therefore have the

potential to be upgraded with far less cost than a completely new site. A business case

demonstrating the number of clients served or strategic benefit is still required. Of the three

carriers, Telstra has more of these assets than Vodafone and Optus.

The local access network has one or more bands of spectrum deployed based on spectrum for the

areas, expected traffic demands on the site and other related factors. Local Access licences

breakdown into the bands of spectrum deployed in the area. The acquisition of spectrum is

expensive and complex, as parts of Australia are broken into areas including urban and non-urban.

Depending on the area and the population, carriers will seek to deploy spectrum to reflect their

licences and the strongest attributes to give ‘coverage’ to achieve the best possible results. Having

two bands of spectrum deployed across the region is the minimum objective.

The table below begins to identify the technical design of the carrier networks in each of the Loddon

Mallee local governments. The ‘Point to Point’ and ‘Point to Multi Point’ shaded in light blue is the

transmission network connection towers and is supplying the connection to the internet. The

spectrum (referred to as xxxxMhz or 2 GHz) is how the carriers deliver the local access to customer

handsets/devices.

Table 2: Carrier Sites and Spectrum Licences Overview - Loddon Mallee

Ca

rrie

r S

ite

lice

nse

s/Lo

dd

on

Ma

llee

Co

un

cils

Bu

loke

Ca

mp

asp

e

Ce

ntr

al

Go

ldfi

eld

s

Ga

nn

aw

arr

a

Gre

ate

r B

en

dig

o

Lod

do

n

Ma

ced

on

Ra

ng

es

Mo

un

t

Ale

xan

de

r

Ru

ral C

ity

of

Mild

ura

Swa

n H

ill

To

tal

Site

s

To

tal

Lice

nse

s

Telstra 11 20 5 9 29 13 20 11 36 17 172 2058

Point to Point 7 5 2 2 8 5 8 5 21 10 73 204

Point to Multi

Point

0 1 1 0 1 0 0 1 0 0 4 8

900MHz 8 11 1 3 16 5 11 7 12 7 81 162

2100MHz 0 13 0 0 21 0 8 0 24 11 77 292

1800MHz 0 0 0 0 0 0 0 0 2 0 2 4

Optus 12 11 3 6 20 9 14 8 27 13 123 1122

Point to Point 8 8 2 5 12 8 9 7 15 11 85 234

Loddon Mallee

Overview Report




Mallee Region


ABN 48 153 285 191


Ca

rrie

r S

ite

lice

nse

s/Lo

dd

on

Ma

llee

Co

un

cils

Bu

loke

Ca

mp

asp

e

Ce

ntr

al

Go

ldfi

eld

s

Ga

nn

aw

arr

a

Gre

ate

r B

en

dig

o

Lod

do

n

Ma

ced

on

Ra

ng

es

Mo

un

t

Ale

xan

de

r

Ru

ral C

ity

of

Mild

ura

Swa

n H

ill

To

tal

Site

s

To

tal

Lice

nse

s

900MHz 10 11 2 0 19 6 13 6 23 8 103 336

2100MHz 8 8 2 5 17 8 7 4 14 11 84 336

2GHz 0 4 1 0 13 0 4 1 6 4 33 202

Vodafone 0 5 1 4 11 3 5 5 6 1 41 244

Point to Point 0 4 1 4 8 3 5 5 4 0 34 70

900MHz 0 3 1 0 8 0 3 2 5 1 23 90

2GHz 0 0 0 0 0 0 2 0 0 0 2 14

NBN Co 4 4 3 0 16 11 2 12 0 0 52 630

Point to Point 4 4 2 0 16 11 2 12 0 0 51 118

2300MHz 4 4 2 0 16 11 2 12 0 0 51 118

Source: ACMA June 2014 and DEG interpretation

3.5 Testing Methodology

There are three testing methods used to inform this report:

1. signal strength

• Voice and 3G

• 4G LTE

2. network performance

3. time series network performance

Each testing method serves to build a comprehensive picture of the service standards from all three

carriers and inform the priority builds across the tested area.

3.5.1 Network Performance Tests

The Network Performance tests are sited to evaluate the performance of specific carrier sites and

where possible, also test spectrum performance. The Network Performance Tests (NPTs) are

completed to validate the Signal Strength results and to challenge the carrier network with

download, upload and network response time. This test methodology reflects a real world scenario

for a user, downloading a 2Mb item and uploading a 500Kb item. Both tests are aggregated into a

score as seen in Table 1 below.

Table 3: Network Performance Test Scores

Score Latency/Ping (ms) Download Speed (in Mbps) Upload Speed (in Mbps)

0 - 0 0

1 2000+ 0.01 – 0.25 0.01-0.249

2 1500-1999 0.26-0.50 0.250-0.500

3 1200-1499 0.51- 0.99 0.500-0.749

4 1000-1199 1.00 -1.99 0.750-0.99

5 800-999 2.00 -2.99 1.00-1.99

6 600-799 3.00 – 3.99 2.00-2.49

7 500-599 4.00 – 4.99 2.50-4.99

8 300-499 5.00 – 9.99 5.00-7.49

9 200-299 10.00 – 19.99 7.50-9.99

10 100-199 20.00 – 49.99 10.00-14.99

11 75-99 50.00-74.99 15.00-19.99

12 50-74 75.00-99.99 20.00-29.99

13 30-49 100-124.99 30.00-39.99

Loddon Mallee

Overview Report




Mallee Region


ABN 48 153 285 191


Score Latency/Ping (ms) Download Speed (in Mbps) Upload Speed (in Mbps)

14 20-29 125-149.99 40.00-49.99

15 Less than 20 150 + 50+

3.5.2 Network Performance Time Series Testing The primary Time Series Test used in the Mobile Coverage Testing program is 10 Network

Performance Tests in a series. This serves to validate the individual Network Performance Tests and

puts the individual networks and the devices under a spot light. The overlay of all three test results

onto the same graph (sample below) clearly illustrates the network performance.

Figure 1: Benchmark Location Brisbane CBD – Time Series Testing

Source: DEG MCT 2014

The Time Series Tests combined with the individual Network Performance Tests establishes a robust

profile of the carrier performance confirming strengths and highlighting weaknesses.

The sites used for the Greater Bendigo testing program are spread across the local government area

and illustrate the performance of networks with higher and lower investment strategies.

3.5.3 Testing Equipment and Presentation Limitations While all care is taken to ensure the highest quality data capture and result presentation, there are a

number of known limitations:

tests are taken at a point in time and repeated tests may show some variation due to

network performance, weather and electronic interference. Where Time Series Testing

is used, this serves to validate the Network Performance Test results.

any network based on radio technology, device quality or local conditions may prevent

or interfere with mobile reception within coverage areas. e. g. inside concrete buildings,

lift wells, basements, tunnels and road cuttings. High rise buildings may also suffer

degradation of service

all results are indicative of signal strength at one point in time at any given location from

a given provider, are not represented in a time scale over, and therefore are not

necessarily representative of the mean signal strength in any place over a given period

of time

variations between equipment can assist or limit the results. DEG use identical

smartphones to remove most of the potential variables.

0

2

4

6

8

10

12

14

1 2 3 4 5 6 7 8 9 10

Mb

ps

Telstra DL Optus DL Vodafone DL

Telstra UL Optus UL Vodafone UL

Loddon Mallee

Overview Report




Mallee Region


ABN 48 153 285 191


4. Mobile Coverage Survey Results As part of the mobile phone and device blackspot assessment, Regional Development Australia

(RDA) Loddon Mallee wanted to gather feedback from the community around the location of

blackspots, the carriers being used and the types of devices people were experiencing problems

with.

The survey asked the following questions:

1. What is the location of the Mobile Phone or Internet Coverage Blackspot address you are

registering?

2. Which mobile carrier are you using at the Blackspot location?

3. Why are you describing this location as a Blackspot?

4. What device are you using at the Blackspot location?

Over the 9 weeks the survey was available online, 362 respondents completed the survey. The

following map shows the distribution of locations identified as blackspots by the community.

Map 4: Survey Blackspot Locations to 20 September 2014

Loddon Mallee Region Survey Results

Sources: Google Earth 2014, Victorian Local Government Areas, & DEG interpretation

Loddon Mallee

Overview Report




Mallee Region


ABN 48 153 285 191


In response to the survey question regarding the carrier respondents are using at the locality they

are identified as a Blackspot, Telstra was the carrier most commonly identified. From a list of 22

carriers or resellers, 81.46% nominated Telstra, followed by Optus (14.33%) and Virgin (1.69%).

Vodafone also registered 1.69%. The balance was made up of Amaysim, Community Telco Australia

and Other, each with less than half a percent.

With over 4 out of 5 users using Telstra and just over 1 in 10 using Optus, these two network

providers are key to delivering network performance improvements that can deliver positive

outcomes for the majority of the user base.

With respect to the question, ‘Why are you describing this location as a Blackspot?’ we were

interested to understand if the ‘blackspot’ was being registered as a result of issues with mobile

phone coverage, mobile internet coverage, or both. One in five users can’t make or receive a mobile

phone call at the location they have registered. The largest proportion of respondents (35.21%) cited

patchy/inconsistent for both mobile phone and mobile internet access. When this is combined with

the 20.28% who were unable to make calls or use mobile internet, over half are either in a complete

blackspot or the network performance is consistently unreliable for a positive user experience.

Almost 4 out of 10 users have Apple Phones. A further 31% identified a blackspot for any device they

use. The next largest proportion of users at 20.06%, are users of Android operating system phones.

Very few users have Blackberry or Windows based phones. Tablet based devices also score very low

in this survey. See Attachment 1 for graphs of the results for all survey questions.

The survey responses have been used by DEG to help inform the priority actions for each local

government area.

Loddon Mallee

Overview Report




Mallee Region


ABN 48 153 285 191


5 Mobile Coverage Testing Results The Mobile Phone and Device Blackspots Connectivity Assessment for the Loddon Mallee Region

highlights the digital divide that the region is seeking to overcome. There are no areas with 4G

Advanced services from any of the carriers and 4G is only available at a limited number of locations

across the region. The region has a mixture of city/urban, regional, rural and remote areas when

referenced against the Digital Divide and Location Comparison developed by DEG for mobile

coverage assessment.

All parties will need to focus on reducing the extent of mobile phone and mobile broadband

blackspot coverage and push for higher penetration of 4G and 4G Advanced. Capital cities and urban

locations may always have another level of technology first, but regions need to push to narrow the

divide and remain attractive to retain population and attract new local investment.

Table 4: Digital Divide and Location Comparison

Source: DEG 2014

5.1 Introduction

The signal strength testing is undertaken for each of the three major carriers: Telstra, Optus and

Vodafone. The smart phone devices are typically set to generate markers every 50m.

The tests are exported to a GIS platform to allow a rapid on site assessment of the full range of signal

strengths from Low Signal Range to High Signal Range and blackspot locations. This assessment

phase also involves a comparison of the test results with the carrier advertised coverage maps. The

Signal Strength Test evaluates the strength of the signal from the local tower to the testing location.

Figure 2: Signal Strength – Rural Town (left) & – Town Centre (right)

Sources: Google Earth 2014 and DEG 2014

Loddon Mallee

Overview Report




Mallee Region


ABN 48 153 285 191


The Signal Strength Test involves the capture of phone signal strengths from 0 through to 31. Where

the signal is zero, a blackspot is registered. The remaining 31 bands are broken into:

1-10 (red shades) as the Low Signal Range, poorest signals

11-20 (blue shades) as the Mid Signal Range representing the middle of the spectrum and

21-31 (green shades) representing the High Signal Range and the strongest signals possible

Figure 3: Signal Strength – Colour Ranges and Settings

5.2 Tested Routes

The proposed testing routes for the Loddon Mallee Region included approximately 5,095klms of

testing. Approximately 4,716klms were driven capturing Voice and 3G results and 379klms for 4G

LTE. The Maps below illustrates the actual Voice 3G and 4G LTE routes completed during testing.

Map 5: Routes used for Voice & 3G testing

GSM & 3G Testing 4,716klms

Sources: Google Earth 2014, Victorian Local Governments & DEG overlay

Loddon Mallee

Overview Report




Mallee Region


ABN 48 153 285 191


Map 6: Routes used for 4G LTE testing

4G LTE Testing 379klms

Sources: Google Earth 2014, Victorian Local Governments & DEG overlay

5.3 Voice and 3G Blackspots

Blackspots are locations or sections of road where no signal can be found, resulting in failure to

connect to the network. The identification of a blackspot (Map below) begins with the signal

strength markers collected across the region.

The Voice & 3G signal strength testing for whole of the Loddon Mallee Region covered approx.

4,716klms and generated approx. 94,320 markers for each of the three carriers (with signal strength

taken every 50m). The resultant 282,960 markers provide a strong and detailed evidence base

showing the real extent of network coverage for mobile phones.

Table 5: 3G & Voice distance and total number of tests for all 3 Carriers.

Loddon Mallee

Overview Report




Mallee Region


ABN 48 153 285 191


This data has then been filtered and mapped to highlight coverage blackspots. The individual Council

reports contain details maps showing the roads tested and the extent of blackspots in the area. The

colour code is as follows:

Black – no signal for Telstra, Optus and Vodafone

Orange - Optus and Vodafone have no signal – Telstra is generating a signal

Yellow – No Optus signal – Telstra and Vodafone have signal

Red - No Vodafone signal – Telstra and Optus have signal

Blue – No Telstra signal – Optus and Vodafone have signal

Green – Telstra and Optus have no signal – Vodafone has signal

Purple – Telstra and Vodafone have no signal – Optus has signal

The Table below highlights the concentration of blackspots on rural roads away from urban centres.

There is a wide variance in the extent of three carrier blackspots – from zero klms in Campaspe to

31.5klms in the Macedon Ranges. Overall though the three carrier blackspots represented only

2.86klms of the roads tested. Vodafone non coverage is the most significant of the three with

16.14% in their own right and 27.15% when all combinations are added together. Optus has the next

largest number of blackspot kilometres and Telstra the smallest with only 3.99% in their own right

and 9.07% when all combinations are added together.

Council and regional representatives will need to remember when talking to carriers, that the testing

was done with a smart phone with a strong antenna. Users with handheld devices with smaller

antennas or seeking to call/connect indoors will experience further degrading of the signals strength.

Table 6: Summary of Voice and 3G Blackspots

GSM & 3G Signal Strength

Coverage Category

Bu

loke

Ca

mp

asp

e

Ce

ntr

al G

old

fie

lds

Ga

nn

aw

arr

a

Gre

ate

r B

en

dig

o

Lod

do

n

Ma

ced

on

Ra

ng

es

Mo

un

t A

lexa

nd

er

Mild

ura

Swa

n H

ill

tota

ls

Pe

rce

nta

ge

s

White 486.6 253.7 145.1 259.3 245.9 199.4 306.7 215.9 479.6 310.7 2,902.9 61.55

Black 1.2 0.0 8.1 8.2 16.2 15.5 31.5 7.2 30.2 16.8 134.9 2.86

Orange 4.4 2.4 48.6 16.9 32.8 79.8 44.7 31.4 37.5 31.4 329.9 6.99

Yellow 12.0 32.0 18.9 17.3 36.3 15.2 83.7 22.0 23.6 33.1 294.2 6.24

Red 20.0 86.8 86.2 55.4 75.5 167.5 49.1 92.0 36.8 92.2 761.4 16.14

Blue 58.1 6.7 1.0 41.6 0.5 5.0 0.9 3.5 43.2 27.8 188.3 3.99

Green 4.9 1.8 0.2 9.0 0.8 9.1 2.5 2.4 8.3 10.8 49.9 1.06

Purple 0.8 10.6 1.7 7.3 5.5 7.5 6.9 4.7 6.6 3.1 54.9 1.16

Total 588.0 394.0 310.0 415.0 413.4 499.0 526.0 379.0 665.9 526.0 4,716.3 100.0

5.4 4G LTE Blackspots Digital Economy Group tested for 4G signals in the Loddon Mallee region above and beyond the

requirements of the contract. The locations selected for 4G were based on a review of carrier

coverage maps. In the Loddon Mallee region, only Telstra identified a strong presence with 4G. As a

result Mildura, Swan Hill (North and South), Echuca, Bendigo and Castlemaine were specifically

tested. In addition, the Calder Freeway from Melbourne to Bendigo was tested to establish the

extent of major highway arterial with 4G coverage.

Loddon Mallee

Overview Report




Mallee Region


ABN 48 153 285 191


Table 7: Summary of 4G Blackspots for the whole of the Loddon Mallee

4G LTE Signal Strength Coverage Category klms percent

White - coverage from all three carriers 0 0.00

Black – no signal for Telstra, Optus and Vodafone 104.67 43.45

Orange - Optus and Vodafone have no signal – Telstra has signal 120.53 50.03

Yellow – No Optus signal – Telstra and Vodafone have signal 0 0.00

Red - No Vodafone signal – Telstra and Optus have signal 0 0.00

Blue – No Telstra signal – Optus and Vodafone have signal 0 0.00

Green – Telstra and Optus have no signal – Vodafone has signal 2.00 0.83

Purple – Telstra and Vodafone have no signal – Optus has signal 13.72 5.69

Total 240.92 100.00

The Towns/Cities of Mildura, Swan Hill, Bendigo and Echuca have 4G coverage from Telstra but not

Optus and Vodafone. This is consistent with the carrier coverage maps. Gisborne and Gisborne South

have Telstra and Vodafone 4G and some Optus coverage.

The extent of Optus and Vodafone coverage for 4G is disappointing and leaves significant scope for

improvements by both of those carriers. The Telstra coverage along the Calder Freeway is also very

poor. In contrast, testing by DEG on freeways within 150klms of our national capitals has usually

generated a 4G presence by Telstra and coverage by Vodafone and Optus in patches (relating to

urban areas).

If 4G LTE signal testing had been completed alongside the 3G & Voice testing, the table above would

have potentially shown over 4,600klms of blackspots for all three carriers.

The inclusion of the 4G testing results in all reports has been done to highlight the absence of 4G

coverage from the three national carriers in all but the most highly urbanised areas. For the Loddon

Mallee region to remain competitive, mobile coverage will need to be improved in not just 3G

coverage but also 4G LTE, by all three carriers.

Loddon Mallee

Overview Report




Mallee Region


ABN 48 153 285 191


Map 7: Loddon Mallee 4G LTE Blackspots

Sources: Google Earth 2014, Victorian Local Government Areas & DEG interpretation

Loddon Mallee

Overview Report




Mallee Region


ABN 48 153 285 191


5.5 Network Site Test locations and assessment overview Network Performance Tests were conducted in 559 locations across the Loddon Mallee Region in

August 2014. The testing methodology (outlined above) replicates a real world user experience.

Whilst the individual site tests do allow for network performance variation, the sample Time Series

Tests below demonstrate that network performance generally remains within a band. As a result,

network performance results are generally within plus or minus one of that score achieved when

repeated over time. The Map below shows the results for Telstra across the whole of the Loddon

Mallee. To see all three carrier results together refer to Attachment 4.

Map 8: Network Performance Test Locations for all of Loddon Mallee (using Telstra results)

Sources: Google Earth 2014, Local Government Boundaries & DEG interpretation

To illustrate the strengths and weaknesses of the respective networks, three tables are shown

below. They have the aggregate scores from ‘very good’ to ‘very poor’ for each of the ten local

governments for Telstra, Optus and Vodafone. These three tables are based on the detailed

assessments documented in the ten individual council reports.

The overall performance of each of the three carriers is highlighted in five colour bands to inform the

assessment and proposed priorities for this local government. The five colour bands are:

Blue: Very Good results – highlights locations with results that stand out for the location

Green: Good results - matched expectations set by coverage maps and current technologies

used to service that location.

White: Acceptable results, largely consistent with coverage map expectations but not

necessarily reaching the advertised technology speeds of the carrier.

Loddon Mallee

Overview Report




Mallee Region


ABN 48 153 285 191


Amber: Poor results inconsistent with coverage maps and/or not performing to the

standards/expectations set by advertising, this is a location that is considered to be a priority

for improved coverage/capacity to deliver the economic and community objectives of the

local government and regional organisations

Red: blackspot or very poor results and may be inconsistent with coverage maps or not

performing to the standards/expectations set by advertising or a location that is considered

to be a priority for improved coverage/capacity to deliver the economic and community

objectives of the local government and regional organisations

Table 8: Consolidated Network Performance Test Scores -Telstra

Telstra

Network

Performance Test

Results

Bu

loke

Ca

mp

asp

e

Ce

ntr

al G

old

fie

lds

Ga

nn

aw

arr

a

Gre

ate

r B

en

dig

o

Lod

do

n

Ma

ced

on

Ra

ng

es

Mo

un

t A

lexa

nd

er

Mild

ura

Swa

n H

ill

tota

ls

Pe

rce

nta

ge

s

Very Good 0 2 0 0 0 0 0 1 1 1 5 1

Good 20 21 16 10 17 9 16 20 20 15 164 29

Acceptable 25 34 26 31 22 26 34 37 32 27 294 53

Poor 6 0 3 6 3 0 2 0 3 4 27 5

Very Poor 5 2 6 14 7 10 9 3 3 10 69 12

Total 56 59 51 61 49 45 61 61 59 57 559 100

In Loddon Mallee, Telstra only achieved a total of 5 tests rated ‘very good’ out of the 559 completed.

164 of the tests were rated ‘good’, while over 53% or 294 were rated as ‘acceptable’. Their ‘poor’

rated sites numbered 27 and ‘very poor’ numbered 69. When compared with the Optus and

Vodafone results here, Telstra has performed strongly. If these tests were undertaken in a capital

city location they could all be expected to be a level higher.

Table 9: Consolidated Network Performance Test Scores -Optus

Optus

Network

Performance Test

Results

Bu

loke

Ca

mp

asp

e

Ce

ntr

al G

old

fie

lds

Ga

nn

aw

arr

a

Gre

ate

r B

en

dig

o

Lod

do

n

Ma

ced

on

Ra

ng

es

Mo

un

t A

lexa

nd

er

Mild

ura

Swa

n H

ill

tota

ls

Pe

rce

nta

ge

s

Very Good 0 0 0 0 0 0 0 1 0 0 1 0

Good 2 0 0 0 0 1 1 0 0 0 4 1

Acceptable 51 48 18 52 38 26 25 41 48 50 397 71

Poor 1 4 5 7 0 0 10 1 5 0 33 6

Very Poor 2 7 28 2 11 18 25 18 6 7 124 22

Total 56 59 51 61 49 45 61 61 59 57 559 100

Optus was only able to achieve a total of 5 sites with ‘very good’ or ‘good’. The majority of their site

tests (397) or 71% were rated as ‘acceptable’. The Optus ‘poor’ rated sites numbered 33 or 6% and

‘very poor’ 124 or 22%. Optus has considerable ground to cover in order to match Telstra in this

Loddon Mallee

Overview Report




Mallee Region


ABN 48 153 285 191


Region and further to go to become comparable with their performance across Australian capital

cities.

Table 10: Consolidated Network Performance Test Scores -Vodafone

Vodafone

Network

Performance

Test Results

Bu

loke

Ca

mp

asp

e

Ce

ntr

al G

old

fie

lds

Ga

nn

aw

arr

a

Gre

ate

r B

en

dig

o

Lod

do

n

Ma

ced

on

Ra

ng

es

Mo

un

t A

lexa

nd

er

Mild

ura

Swa

n H

ill

tota

ls

Pe

rce

nta

ge

s

Very Good 0 0 0 0 1 0 0 1 0 0 2.0 0.36

Good 0 8 1 0 3 1 6 1 1 0 21.0 3.76

Acceptable 2 21 14 9 24 6 34 22 26 16 174.0 31.13

Poor 0 1 6 1 2 1 4 1 3 0 19.0 3.40

Very Poor 54 29 30 51 19 37 17 36 29 41 343.0 61.36

Total 56 59 51 61 49 45 61 61 59 57 559.0 100.0

Vodafone has some ratings better than Optus but overall as a Carrier, they have the poorest

performing network. At the high end, Vodafone achieved 2 sites with ‘very good’ and 21 rated

‘good’. Their middle of the road result for ‘acceptable’ achieved only 174 sites or 31%. This result is

over 200 sites behind Optus. Where Vodafone was also considerably behind Optus and Telstra was

in the ‘poor’ and ‘very poor’. Their results were 19 and 343 (61%). Amongst the survey respondents,

Vodafone was not well represented with less than 1% of the total carrier profile. While local people

may not be using Vodafone, many Vodafone customers from the highly populated urban areas will

have a poor user experience when in this region.

5.6 Network Performance Time Series Tests Network Performance tests in a time series serve to amplify the quality of the network over 10

repeated Network Performance tests. Three network characteristics are separately recorded: Ping

(latency or time to connect to the internet and return), download and upload. Across the Region, 50

test locations were used to highlight the strengths and weaknesses of the respective networks.

The individual reports contain the results and commentary for each test by location and each carrier.

Overlapping the 50 test location results on a graph would result in a congested illustration. The

condensed network performance test results in the tables above adequately highlight and amplify

the results of individual locations. Readers are encouraged to review the results of the Time Series

Tests in each for the 10 individual local government reports. The Map below illustrated the locations

where the 50 Time Series Tests were undertaken.

Loddon Mallee

Overview Report




Mallee Region


ABN 48 153 285 191


Map 9: Network Performance Time Series Test Locations for all of Loddon Mallee


Loddon Mallee

Overview Report




Mallee Region


ABN 48 153 285 191


5 Regional Priorities The key regional priorities for the Loddon Mallee Region and individual councils are to:

� Short list the priorities in each of the 10 individual local government reports to the top 1 or 2

locations/ outcomes

� Build relationships with the Carriers using these reports and in partnership, identify the locations

where carriers are prepared to build new sites, upgrade existing sites and deploy new spectrum.

This can deliver reduced blackspots, improved coverage, competition and capacity

� To actively pursue the Commonwealth Government’s forthcoming Mobile Coverage Programme

as a way to increase coverage beyond current carrier investment plans. Where possible also

leverage off the new NBN Co Fixed Wireless builds where there is a value add

� Look for ways individually or collectively to share impartial information for the benefit of

consumers and business to:

consider which carrier to use

the best handsets to use (for their location)

technology that is available to amplify signals the whole of life cycle cost of using

alternatives to their current practice

Loddon Mallee

Overview Report




Mallee Region


ABN 48 153 285 191


6 Conclusion Having the mobile broadband blackspots independently tested and mapped is the first step towards

improving the mobile broadband basis for a strong digital economy. In the same way that local

governments know, understand, and seek funding for priority infrastructure in their area, carrier

network infrastructure is also critical.

The difference with mobile digital infrastructure to traditional council infrastructure is that it is

privately owned. The primary tactic for facilitating increased investment is knowledge of the

network, its performance and choosing priority locations (in partnership with the carriers.)

Carriers look to councils for two key types of support:

The first and most important is facilitation through the approvals process. Councils need to

see the investment in new mobile sites (upwards of $800,000 per site) in the same way that

a development application delivering new employment or business growth gets support. The

recent studies by Ericson and 5Chalmers University demonstrating that doubling broadband

speeds increased the GDP by 0.3% needs to be considered

The second is the support where leases are required for use of council owned or controlled

land. Often legal firms acting for councils or councils own representatives do not seek to

facilitate the timely completion of a standard legal agreement. Each protracted completion

or delay creates a reputation profile for the local government.

Carriers enter into a more productive dialogue when a local government or Regional Organisation of

Councils has independently tested blackspot mapping and have a strong knowledge of the digital

infrastructure of the area. Carriers ultimately have a large number of sites in various locations and

jurisdictions. Locations where approvals and leases are completed easily will have networks

established faster and sooner.

Loddon Mallee

Overview Report




Mallee Region


ABN 48 153 285 191


Attachment 1: Current Carrier Infrastructure The following three Maps show the current (as at 30 June 2014) infrastructure providing local access

services for mobile phone and mobile internet. Where NBN Co Fixed Wireless sites are planned or

are in operation is also shown. NBN Co represents an alternative site option for mobile carriers to

use to expand their own network.

Source: ACMA Radio Frequency Licences - Optus - as at 30 June 2014, Google Earth 2014, Victorian

Local Government Boundaries & DEG interpretation.

Loddon Mallee

Overview Report




Mallee Region


ABN 48 153 285 191


Source: ACMA Radio Frequency Licences - Vodafone - as at 30 June 2014, Google Earth 2014,

Victorian Local Government Boundaries & DEG interpretation.

Loddon Mallee

Overview Report




Mallee Region


ABN 48 153 285 191


Source: ACMA Radio Frequency Licences -Telstra- as at 30 June 2014, Google Earth 2014, Victorian

Local Government Boundaries & DEG interpretation.

Loddon Mallee

Overview Report




Mallee Region


ABN 48 153 285 191


Source: ACMA Radio Frequency Licences – NBN Co Fixed Wireless- as at 30 June 2014, Google Earth

2014, Victorian Local Government Boundaries & DEG interpretation.

Loddon Mallee

Overview Report




Mallee Region


ABN 48 153 285 191


Attachment 2: Vodafone Announcement Regarding Roaming Agreement with Optus

Loddon Mallee

Overview Report




Mallee Region


ABN 48 153 285 191


Attachment 3: Survey Question Results in Graph Format

Survey Question - Which mobile carrier are you using at the Blackspot location?

Source: Survey Monkey for Loddon Mallee by DEG

Survey Question - Why are you describing this location as a Blackspot?


Loddon Mallee

Overview Report




Mallee Region


ABN 48 153 285 191


Survey Responses – What device are you using at the Blackspot location?


Loddon Mallee

Overview Report




Mallee Region


ABN 48 153 285 191


Attachment 4: Network Performance Test Results by Carrier Maps showing the location and high-level indication of mobile internet coverage and blackspots for

all three national carriers. A table showing individual results can be seen in the report above.

Network Performance Test Locations - Telstra


Loddon Mallee

Overview Report




Mallee Region


ABN 48 153 285 191


Network Performance Test Locations - Optus


Loddon Mallee

Overview Report




Mallee Region


ABN 48 153 285 191


Network Performance Test Locations - Vodafone


Loddon Mallee

Overview Report




Mallee Region


ABN 48 153 285 191


Attachment 5: Loddon Mallee Mobile Coverage Programme Draft Short List Following is a list of Loddon Mallee priority locations that may meet the Commonwealth

Government Mobile Coverage Funding Programme when it is realised in October 2014. The Councils

and Loddon Mallee RDA are encouraged to validate these locations as local priorities and also with

the Carriers.

The Buloke Shire Council Mobile Coverage Programme priorities are:

Priority 1 - The large central area of Buloke to the South of Sealake are affected by

Telstra’s significant and pervasive signal blackspots, weak Telstra and Optus internet

connectivity and absence of Vodafone internet connectivity. The carriers have designed

their networks to take advantage of the flat terrain, however survey responses here

suggest that the networks remain inadequate. In spite of the Optus and Vodafone

‘signals’, this area is considered a justifiable candidate for the Mobile Coverage

Programme:

� This area will require short term assessment of possible new site(s) in time for

the Carriers to access the national Mobile Coverage Programme to be released

towards the end of 2014.

Priority 2 - The areas to the West and Northwest of Donald are affected by signal

strength blackspots for Telstra, Optus and Vodafone together with poor internet

connectivity. This is a potential Mobile Coverage Programme candidate.




The Gannawarra Shire Council Mobile Coverage Programme priorities are:

Priority 1 - The area to the West of Kerang has blackspots for all three carriers,

combined with non-coverage by Optus or both Optus and Vodafone. The absence of

signal from any of the three carriers over significant proportions of this area makes it a

strong candidate for the Mobile Coverage Programme:




The Swan Hill Shire Council Mobile Coverage Programme priorities are:

Priority 1 - The area between Manangatang and Piangil in the centre of Swan Hill Shire

Council area. This area is identified by Telstra and Vodafone as non-coverage. The signal

blackspots here show up the network deficiency for all three carriers and makes it a

strong candidate for the Mobile Coverage Programme. The absence of coverage will be

limiting the ability of the broad acre farmers to achieve maximum productivity using

machine to machine technologies enjoyed elsewhere:




Loddon Mallee

Overview Report




Mallee Region


ABN 48 153 285 191


The Rural City of Mildura Mobile Coverage Programme priorities are:

Priority 1 & 2 – Within the two broader priority areas along the Sturt and Mallee

Highways, there are clear blackspot locations for all three carriers. These non-coverage

areas are reflected in the Telstra and Vodafone coverage maps. The absence of signal

from any of the three carriers over significant proportions of these two areas make them

a strong candidate for the Mobile Coverage Programme:




The Loddon Shire Council Mobile Coverage Programme priorities are:

Priority 1 - The area to the North of Mitiamo including Sylvaterre and Terrick Terrick.

This area has large contiguous blackspots for all three carriers and combinations of each

or individually. The absence of signal from any of the three carriers over significant

proportions of this area make it a candidate for the Mobile Coverage Programme:




The Central Goldfields Shire Mobile Coverage Programme priorities are:

Priority 1 - The area to the South of Maryborough, particularly the blackspot locations.

The two areas that are blackspots are densely vegetated forest or in a deep creek valley.

The tests in these locations simply accentuated the already poor signals for all three

carriers over a large area. The absence of signal from any of the three carriers over

significant proportions of this area make it a strong candidate for the Mobile Coverage

Programme:




The City of Greater Bendigo Mobile Coverage Programme priorities are:

Priority 1 - The area to the North-West of Bendigo around Raywood. This area has large

contiguous blackspots for all three carriers and combinations of each or individually. The

absence of signal from any of the three carriers over significant proportions of this area

makes it a strong candidate for the Mobile Coverage Programme:




Priority 2 - The area to the South-East of Bendigo around Mia Mia. This area has a

significant blackspot. The absence of signal from any of the three carriers at the centre

of this area makes it a candidate for the Mobile Coverage Programme:




Loddon Mallee

Overview Report




Mallee Region


ABN 48 153 285 191


Note: Not all Loddon Mallee Councils have areas that qualify for the known Mobile Coverage

Program Criteria. This may change when the Australian Government releases the EOI Guidelines in

November 2014.

Mobile Coverage Report Loddon Mallee Overview Final Mallee Overview Report Mobile Phone and Device...

Documents

Transcript of Mobile Coverage Report Loddon Mallee Overview Final Mallee Overview Report Mobile Phone and Device...