© 2019 CenturyLink. All Rights Reserved. The CenturyLink mark, pathways logo and certain CenturyLink product names are the property of CenturyLink. All other marks are the property of their respective owners. Services not available everywhere. Business customers only. CenturyLink may change or cancel services or substitute similar services at its sole discretion without notice.

CenturyLink® Cloud Connect:MPLS/IPVPN to Microsoft Azure via Azure portal

Azure Resource Manager (ARM)

Direct, Secure, Private Connection to Microsoft Azure

November 7th, 2018

ContentPurpose (slide 2)Roles and Responsibilities (slide 3)Background Information (slides 4-5)Steps 1-7 (slides 6-14)About Public and Microsoft Services / New Peering (slide 15)Workflow for Microsoft Peering (slide 16)Microsoft ExpressRoute Resources (slides 17-18)

Purpose

The purpose of this document is to provide an end-to-end walk through for a customer setting up ExpressRoute for the first time via CenturyLink’s Cloud Connect. Information contained is provided to serve as a supplement to Microsoft documentation linked throughout this document. Users should check the provided links to obtain the most up-to-date information and for more details pertaining to Microsoft processes.

Disclaimer: The material in this guide is for informational purposes only and is taken from Microsoft Azure’s website material. All Microsoft related configuration information is based off of the Azure Resource Manager (ARM) portal environment.

2

3

Roles and ResponsibilitiesSTEPS REQUIRED TO SET UP AZURE EXPRESSROUTE

CONNECTIVITYEnd

Customer CenturyLink Microsoft Azure(Automated via portal)

SET UP PHYSICAL CONNECTIVITY TO AZURE EXPRESSROUTE LOCATIONDecide on the type of BGP peering required (Azure Private Peering-IaaS or Microsoft Peering-PaaS/SaaS) XOrder Layer 3 (MPLS) Cloud Connect service to Azure ExpressRoute location from CenturyLink Account Team XOrder MSFT Azure ExpressRoute connection via MSFT Azure Portal, using “Level 3 Communications – IPVPN” as the Service Provider name, with the appropriate bandwidth and location. *see your Cloud Connect Solutions Architect for more details or direction.

X

Provision Layer 3 (MPLS) Service device with BGP, connecting to MSFT Azure ExpressRoute XProvision ExpressRoute circuit and provide the ExpressRoute Service Key to CenturyLink XSET UP BGP PEERING BETWEEN CENTURYLINK PROVIDED CUSTOMER EDGE AND AZURE EDGE DEVICE

Configure BGP Peering on CenturyLink PE Routers XConfigure BGP Peering on Azure side X*** Configure BGP Route Filtering (required for Microsoft Peering PaaS/SaaS) XLINK SERVICES ON AZURE TO THE DEDICATED CIRCUIT

Link virtual Network(s) to the dedicated circuit* X

*Connectivity to services hosted on Public IPs is enabled as soon as the dedicated circuit has been enabled

Roles and Responsibilities

Background Information

Microsoft Azure ExpressRoute lets you create private connections between Microsoft datacenters and the infrastructure that’s in a co-location environment. ExpressRoute connections offer higher security, more reliability, faster speeds and predictable latencies than typical connections over the Internet. In some cases, using ExpressRoute connections to transfer data between your on-premises network and Azure can also yield significant cost benefits.

Azure offers circuit bandwidths from 50 Mbps to 10 Gbps (50Mbps, 100Mbps, 200 Mbps, 500 Mbps, 1 Gbps, 2 Gbps, 5Gbps, and 10 Gbps).

Azure compute services, namely virtual machines (IaaS) and virtual networks (VNETs) deployed within a virtual network can be connected through the Azure Private Peering domain.

PaaS Services such as Azure Storage, SQL databases and Web Apps are offered on public IP addresses. You can privately connect to services hosted on public IP addresses, including VIPs of your cloud services, through the Microsoft Peering routing domain. You can connect the Microsoft Peering domain to your extranet and connect to all Azure services on their public IP addresses from your WAN without having to connect through the Internet

What is Microsoft ExpressRoute (https://azure.microsoft.com/en-us/documentation/articles/expressroute-introduction/)

4

and IPv6 and IPv6

ExpressRouteLocation

Cloud Connect for Microsoft ExpressRoute

5

Microsoft Datacenters

MicrosoftEdge

CTL PERouter

Private PeeringMicrosoft Peering

VLANS &BGP Peers

Azure ComputeAuzre Private Peering

Microsoft Peering

MPLS Network• Customer is responsible for express route costs and

configuration• Firewall / NAT services will be provided by CenturyLink when

accessing Microsoft Peering for PaaS/SaaS Services

High Level Step Review

1. Customer signs into Azure portal2. Customer creates a new ExpressRoute circuit 3. Customer views the circuits and properties4. Customer requests CenturyLink Cloud Connect service5. Upon request, customer sends the service key to

CenturyLink Technical Design Engineer for Cloud Connect provisioning.

6. CenturyLink provisions Cloud Connect to MS ExpressRoute

7. Customer completes Azure configuration, attaching any VNET’s and/or accessing any Public/Office365 resources

Source: https://azure.microsoft.com/en-us/documentation/articles/expressroute-howto-circuit-portal-resource-manager/

6

1) Customer signs into Azure portal

Sign into Azure @ http://portal.azure.com/

7

2) Customer creates a new ExpressRoute CircuitAfter clicking ExpressRoute, portal will display ‘Create ExpressRoute circuit’ blade. When filling in the values on this blade, here are some helpful tips:• Select the Provider as Level 3 Communications – IPVPN

• Select the appropriate ExpressRoute location.• Note: Silicon Valley = San Jose; Washington DC = Ashburn

• Specify the correct SKU for Tier and Data Metering:• SKU / Tier determines whether an ExpressRoute standard or an

ExpressRoute premium add-on is enabled. • Billing Model / Data Metering determines the billing type that

Microsoft will use to bill the customer directly for ExpressRoute. • Note that the billing type can be changed from Metered to Unlimited,

but may not be changed from Unlimited to Metered

• Select the appropriate Subscription and Resource Group• User must have a subscription type set, such as Pay-As-You-Go• A Resource group is a collection of resources that share the same

lifecycle, permissions, an policies.• Additional information can be found here:

https://azure.microsoft.com/en-us/documentation/articles/resource-group-portal/

Important:Please be aware that the ‘Peering Location’ indicates the physical location where you are peering with Microsoft. This is not linked to "Location" property, which refers to the geography where the Azure Network Resource Provider is located.

8

Level 3 Communications - IPVPN

(cont) 2) Customer creates a new ExpressRoute circuit

Create an ExpressRoute circuit by selecting the option to create a new resource.

9

3) Customer views the circuits and properties

View all created ExpressRoute circuits by selecting All resources on the left-side menu.

10

(cont) 3) Customer views the circuits and properties

11

Le ve l 3 Communications - IPVPN

Level 3 Communications - IPVPN

4) Customer requests CenturyLink Cloud Connect service

• To order a CenturyLink Cloud Connect, contact your CenturyLink Account Representative• Contact your CenturyLink account rep to assist in ordering a Cloud Connect to

ExpressRoute.• Information needed by CenturyLink to complete connection:

• MSFT Azure ExpressRoute Service Key completed during CenturyLink Provisioning steps

• Customer requests Cloud Connect to the appropriate Azure ExpressRoute Location

• Bandwidth of MPLS Connection requested (typically matches ExpressRoute speed)

• What Azure service(s) are you connecting to:• Azure Private Peering (Compute/IaaS)• Microsoft Peering (Azure PaaS, Office 365, Dynamics 365, etc)

• Cloud Connect contractual term length• i.e. 1year, 3year, etc.

12

5) Upon request, customer sends the service key to CenturyLink for Cloud Connect provisioning

• The CenturyLink Technical Design Engineer will request the ExpressRoute Service Key from the customer prior to provisioning but after Order Entry.

• On this blade, Provider status provides information on the current state of provisioning on the service-provider (CenturyLink) side. Circuit status provides the state on the Microsoft side.

• When creating a new ExpressRoute circuit, the circuit will be in the following state:

– Provider status: Not provisioned– Circuit status: Enabled

• The circuit will change to the following state when the connectivity provider (CenturyLink) is in the process of enabling it:

– Provider status: Provisioning– Circuit status: Enabled

• To be able to use an ExpressRoute circuit, the circuit must be in the following state:

– Provider status: Provisioned– Circuit status: Enabled

13

Le ve l 3 Communications - IPVPN

Level 3 Communications - IPVPN

6) CenturyLink provisions Cloud Connect to MS ExpressRoute

• Upon network order submission, CenturyLink will provision a Layer 3 IPVPN/MPLS connection to the requested ExpressRoute Location

• Turn up of Layer 3 IPVPN/MPLS service to local ExpressRoute interconnect point– Layer 3/BGP will be configured on CenturyLink side and on Azure side– Layer 2 VLAN(s) between CenturyLink and Microsoft will be configured by CenturyLink.

14

• Primary & Secondary IP subnets• Autonomous System Number (ASN) Info• VLAN ID

7) CenturyLink completes configuration, and provides Customer with necessary information that was configured on Azure side per environment, for customer records.

Microsoft Peering (SaaS) now supports Azure Public (PaaS) services

• Microsoft has announced they are combining both their PaaS/SaaS services over a single pair of BGP Peers (Microsoft Peering)

• Before April 1, 2018, ExpressRoute had three peering connections: – Azure Private (IaaS) peering for connecting to Azure Vnets– Azure Public (PaaS) peering to reach Azure PaaS services– Microsoft Peering (SaaS) for Office 365 and Dynamics 365

• To simplify ExpressRoute management and configuration Microsoft has merged Azure Public routes into the Microsoft Peering connection

– Customers can now access Azure PaaS and Microsoft SaaS services via the Microsoft peering connection

• Customers no longer have to have 3 separate peering types to MSFT (Public / Private / MSFT Peering), but rather 2 peering types going forward (Private / MSFT Peering)

• Refer to the following to move Public peering to Microsoft peering: https://docs.microsoft.com/en-us/azure/expressroute/how-to-move-peering

• Note: While customers can receive all PaaS/SaaS services over MSFT Peering, the Office365 service still requires customers to apply for approval directly with Microsoft to enable the Office365 service via ExpressRoute. All other services can be accessed via the MSFT Peering VLAN without a prior approval.

• Please reference these links for additional guidance and direction from Microsoft. Azure ExpressRoute for Office 365 and here Network connectivity to Office 365

15

Workflow for Microsoft Peering

Source: https://azure.microsoft.com/en-us/documentation/articles/expressroute-howto-circuit-portal-resource-manager/

16

• To be able to successfully connect to services through Microsoft peering, you must complete the following configuration steps:

– You must have an active ExpressRoute circuit that has Microsoft peering provisioned You can use the following instructions to accomplish these tasks:o Create an ExpressRoute circuit and have the circuit enabled by your

connectivity provider before you proceed. The ExpressRoute circuit must be in a provisioned and enabled state.

o Have your connectivity provider provision Microsoft peering for your circuit.

– You must create and configure a route filtero Identify the services you wish to consume through Microsoft peeringo Identify the list of BGP community values associated with the serviceso Create a rule to allow the prefix list matching the BGP community values

– You must attach the route filter to the ExpressRoute circuit

Microsoft ExpressRoute Resources

17

Introduction https://azure.microsoft.com/en-us/documentation/articles/expressroute-introduction/

FAQ https://azure.microsoft.com/en-us/documentation/articles/expressroute-faqs/

Pricing http://azure.microsoft.com/pricing/details/expressroute/• Use Exchange Provider Pricing• There is a Premium if you need >4k routes or ability to reach other global regions

Prerequisites https://azure.microsoft.com/en-us/documentation/articles/expressroute-prerequisites/

Circuits & routing domains

https://azure.microsoft.com/en-us/documentation/articles/expressroute-circuit-peerings/

Partners & peering locations

https://azure.microsoft.com/en-us/documentation/articles/expressroute-locations/

Azure Regions http://azure.microsoft.com/en-us/regions/

Designing Materials • https://azure.microsoft.com/en-us/documentation/articles/expressroute-routing/• https://azure.microsoft.com/en-us/documentation/articles/expressroute-nat/

Configuration Materials • https://azure.microsoft.com/en-us/documentation/articles/expressroute-howto-circuit-arm/• https://azure.microsoft.com/en-us/documentation/articles/expressroute-howto-routing-arm/• https://azure.microsoft.com/en-us/documentation/articles/expressroute-howto-linkvnet-arm/• https://azure.microsoft.com/en-us/documentation/articles/expressroute-howto-vnet-portal-arm/

Diversity • Single port includes diversity from IQ+ edge to Microsoft• PE/Path diversity available by ordering 2 IQ ports which would require only a single Express Route

Subscription• Full diversity achieved by ordering at 2 separate locations which would require multiple Express Route

Subscriptions

Notes • Azure Datacenter Public IP Blocks: http://www.microsoft.com/en-us/download/details.aspx?id=41653• Dynamic routing via BGP• Azure Compute supports bring your own private IP

Microsoft Office365 Resources

18

Microsoft’s Office365 via ExpressRoute Approval Form

https://forms.office.com/Pages/ResponsePage.aspx?id=v4j5cvGGr0GRqy180BHbRyOZxByRF1dLgv7k6ye5z8pUQkdLRTQ5QkcyOTU3VkNEOFdOWk9IRDZTUy4u

Overview https://support.office.com/en-us/article/Azure-ExpressRoute-for-Office-365-6d2534a2-c19c-4a99-be5e-33a0cee5d3bd?ui=en-US&rs=en-US&ad=US

O365 Traffic Mgt https://support.office.com/en-us/article/Office-365-network-traffic-management-e1da26c6-2d39-4379-af6f-4da213218408?ui=en-US&rs=en-US&ad=US

Client Connectivity https://support.office.com/en-us/article/Client-connectivity-4232abcf-4ae5-43aa-bfa1-9a078a99c78b

QOS https://azure.microsoft.com/en-us/documentation/articles/expressroute-qos/

Office 365 Locations https://www.microsoft.com/online/legal/v2/?docid=25• O365 has a primary & DR site for each tenant. • Internet access will be proxied through the closest O365 location and backhauled on MS backbone

Address Blocks https://support.office.com/en-us/article/Office-365-URLs-and-IP-address-ranges-8548a211-3fe7-47cb-abb1-355ea5aa88a2

CDN Usage https://support.office.com/en-us/article/Content-delivery-networks-0140f704-6614-49bb-aa6c-89b75dcd7f1f

Network Planning https://support.office.com/en-us/article/Network-planning-and-performance-tuning-for-Office-365-e5f1228c-da3c-4654-bf16-d163daee8848

Implementing ExpressRoute for Office 365

https://support.office.com/en-us/article/Implementing-ExpressRoute-for-Office-365-77735c9d-8b80-4d2f-890e-a8598547dea6

O365 Step-by-stepinstallation

https://support.office.com/en-us/article/Download-and-install-or-reinstall-Office-365-Office-2016-or-Office-2013-on-your-PC-or-Mac-4414eaaf-0478-48be-9c42-23adc4716658?ui=en-US&rs=en-US&ad=US

Route Filters https://docs.microsoft.com/en-us/azure/expressroute/how-to-routefilter-portal