Customizing Azure VMs using Python & ExtensionsShweta GuptaSenior Program Manager

$30

$25

$20

$15

$10

$5

2008

2009

2010

2011

2012

2013

2014

2015

2016

2017

2018

2019

2020

Mar

ket

Shar

e (in

Bill

ions)

Public Cloud Platform

What is Azure?

EconomicsScaleSpeed

Microsoft Azure

An overview

Azure’s global footprint19 Regions ONLINE…huge datacenter capacity around the world…and we’re growing

100+ datacentersOne of the top 3 networks in the world (coverage, speed, connections) 2 x AWS and 6x Google number of offered regionsG Series – Largest VM available in the market – 32 cores, 448GB Ram, SSD…

Operational Announced

Central USIowa

West USCalifornia

North EuropeIreland

East USVirginia

East US 2Virginia

US GovVirginia

North Central USIllinois

US GovIowa

South Central USTexas

Brazil SouthSao Paulo

West EuropeNetherlands

China North *Beijing

China South *Shanghai

Japan EastSaitama

Japan WestOsakaIndia West

TBD

India EastTBD

East AsiaHong Kong

SE AsiaSingapore

Australia WestMelbourne

Australia EastSydney

* Operated by 21Vianet

Cloud Services

Load Balancer

WEB ROLEINSTANCES

Tables/NoSQL

TYPE Y

STORAGE SOLUTIONS

Database

CACHE

Blobs/Files

TYPE X

QUEUE

Virtual Machines

VIRTUAL MACHINES

STORAGE BLOBS / FILES (Virtual Disks)

…

Windows

Linux

SQL

GalleryLoad Balancer

VIRTUALNETWORK

COMPUTE

VirtualMachines

Get full control over a server in the cloud and maintain it as your business requires.

CloudServices

Managed Virtual Machines with specific web and worker roles that are stateless

Batch

For running large scale parallel and high performance computing (HPC) applications

Scheduler

Create jobs that run reliably on simple or complex schedules to invoke any type of service.

Remote App

Access Windows apps that run within the Service on VM’s from any device and any location.

NETWORKING

VirtualNetwork

Provision and manage VPNs in Azure and securely link to your on-premises IT infrastructure.

ExpressRoute

Connect on-premises and cloud data centers directly through dedicated, non-internet lines.

Traffic Manager

Load-balance incoming global traffic across multiple services running in multiple data centers.

IDENTITY & ACCESS

ActiveDirectory

Identity and access management for cloud applications and ability to link to on-premises Server AD.

Multi-FactorAuthentication

Safeguard access to data and apps with additional physical layer of security control.

MEDIA & CDN

Content DeliveryNetwork (CDN)

Cache content for your apps at 100’s of edge locations to improve user experiences.

MediaServices

Range of services that support video on-demand and live streaming workflows.

WEB & MOBILE

Web Apps

Managed web platform, get started for free and scale as you go using many tools/ languages.

Add backend capabilities to mobile apps, with native client support on most device platforms.

MobileApps

APIManagement

Publish and Manage APIs to developers, partners and employees securely and at scale.

Create and surface your app logic as APIs for other services and apps to consume.

APIApps

LogicApps

Build/execute business processes by linking your own custom API’s with an API Gallery/Marketplace

NotificationHubs

Deliver millions of cross platform push notifications from any application backend, anywhere.

GALLERY DEPLOY

YOUR CODE

APP TYPES

Load Balancer

API MARKETPLACE…

API APP WEB APPLOGIC APP MOBILE APP

Windows PhoneiOSAndroidNokia X

Windows StoreiOSAndroidHTML5/JS

APP INSTANCES

App Service

STORAGE & BACKUP

Backup

Managed service that handles backup/restore of Windows Server machines/backup agent.

StorSimple

Automated, policy driven solution to extend on-premises primary storage for backup / DR.

SiteRecovery

Coordinate replication and recovery of System Center private clouds

Storage Blobs& Files

Store binary application data and web content – store for dedicated and shared virtual disks for VM’s

Import/Export

For massive data transfer – ship encrypted disks to move data in/out of blob storage.

DATA

SQLDatabase

Managed relational database service with high availability and selectable performance levels.

DocumentDB

Store/retrieve millions of JSON objects from a highly scalable NoSQL document database.

RedisCache

Make applications scale and be more responsive under load by keeping data closer to app logic.

Search

Managed, scalable search service for your apps, create tunable search results and ranking models.

Tables

Massive scale for semi-structured key/value type data in this schema-less NoSQL store.

ANALYTICS

HDInsight

Big Data (based on Apache Hadoop) analytics that integrate easily with Microsoft Office.

MachineLearning

Mine historical data with compute power to predict future trends or behavior.

StreamAnalytics

Process data streams in real-time to discover and react to trends.

DataFactory

Ingest data from multiple sources to combine into a cloud based Data Warehouse.

EventHubs

Ingest, persist, process millions of events per second from millions of devices.

Ingest, persist, process millions of events per second from millions of devices.

MobileEngagement

DEVELOPER SERVICES

Visual StudioOnline

Store code, plan and track projects, build, deploy and test apps in the cloud collaboratively.

ApplicationInsights

Analyze app usage, availability and performance to detect issues and solve problems proactively.

MANAGEMENT

Automation

Run durable PowerShell scripts to automate frequent, long running, complex Azure tasks.

Portal

Web based experience to provision, control and monitor all Azure services.

OperationalInsights

Analyze and troubleshoot on-premises IT infrastructure without using instrumented code.

KeyVault

Safeguard and control keys and secrets in cloud scale hardware security modules.

HYBRID INTEGRATION

BiztalkServices

Build EDI and Enterprise App Integration (EAI) solutions in the cloud.

HybridConnections

Connect apps in Azure with on-premises resources without a VPN or dedicated line.

ServiceBus

Messaging capabilities (pub/sub, queues) and on-premises to cloud connectivity solution.

StorageQueues

Simple message queue for application de-coupling architecture for scale out.

Store /Marketplace

Find and manage other services provided by third parties.

VM Depot

Find free open source VM images that you can download and run in Azure Virtual Machines.

COMMERCE

Enterprise needs

Microsoft Azurefundamentals

On-premises AND Cloud

IntegrationHeterogeneity

Open, Broadand Flexible

Languages

CMS

Devices

Databases

OperatingSystems

Innovations in the last 18monthsCompute1. G Series2. Azure Batch (preview)3. ARM support for IAAS(preview)4. SSD5. New VM Gallery6. Antimalware for VMs & Cloud

Services7. A8/A9 Compute Intensive

Instances8. SAP on Azure9. Agent Injection in VM’s10.Encrypted VM Disks11.VM- Basic Instance12.Hyper-V Replica13.Site Recovery Manager E2E14.Site Recovery Manager E2A15.Snapshot VM16.Scheduler 17.Automation18.AutoScale 19.Antimalware20.Oracle on Azure

Networking1. Express Route 2. Express Route premium add-

on package3. Express Route and S2S VPN

co-existance4. Azure DNS service(Preview)5. User Defined routing6. Network Appliances7. Multiple VIPs per cloud service8. Network Security Groups9. Forced Tunneling10.Virtual Network: Point to Site11.Virtual Network: Site to Site12.Virtual Network: Cross VNET13.Loadbalance14.Instance Level public IP15.Traffic Manager external

endpoints16.IP reservation17.CDN v.218.Subnet Migration19.Dynamic Routing

Storage1. Premium Storage2. Azure Storage client-side

encryption(preview)3. Azure Site Recovery4. Read Only Secondary Storage5. Read Access Geo Redundant

Storage6. Zone Redundant Storage7. Storage Import/Export Hard Drives8. Azure Files(Preview)9. Storage Tiers(SSD, Disk, Tapes)10.CORS/JSON11.Storage Analytics12.Queue Geo Replication

Infrastructure Services

Azure Backup

Azure Site Recovery1. DR for Vmware VMs

and physical servers(preview)

2. Integration with Azure Automation

3. VM replication to Azure

Innovations in the last 18monthsApplication Services

Mobile Services 1. Event Hub2. API Management3. Hybrid Connections(preview)4. Integrated Active Directory5. AutoScale 6. NET back-end support7. SSO with Active Directory8. Offline Data Sync9. Visual Studio tooling10.Remote debugging11.Xamarin components & SDK12.Sencha extension13.Notification hubs integration14.Android support15.HTML 5/CORS support

Web Sites

1. AAD Authorization2. VPN support3. Redis Cache4. TiP Testing(Preview)5. Websites Basic6. Websites Standard

( enhancements)7. Webjobs8. Backup & Restore(includes DB)9. Java Support10.Staging slots11.Hybrid Connections(preview)12.Autoscale13.Traffic Manager14.Site extensions

Media Services

1. Live Channels & Live Transcoding2. Media encoder premium(preview)3. Content Protection4. Indexer5. VOD Streaming 6. Encoding

Integration Services

1. Hybrid Connections(Preview)2. Biztalk services

Azure App Service launched in April 2015- that brings together functionality of Azure Websites, Azure Mobile Services, and Azure Biztalk Services into a single development experience.

Azure Service Fabric (Dev edition)

Innovations in the last 18monthsData Management & Advanced Analytics

SQL Database1.SQL DB- Elastic scale outs2.Transparent Data Encryption(Preview)

3.SQL DB Service Tier Advisor (preview)

4.SQL DB auditing5.SQL Database data masking6.SQL Database Basic, Standard & Premium SKUs

7.Predictable performance8.Up to 500GB9.99.95% SLA10.Point-in-time recovery11.Geo-replication(standard & Active)

HDInsight1. Support for Storm2. Support for Hbase3. HDInsight GA Q2, FY144. Hadoop 2.2 support5. Hadoop 2.4 support6. Contributions to Hadoop

(improve Hive query 100x)

7. .NET 4.5 support8. Audit + Operation history9. YARN support10.HBase public preview11.Mahout support12.Global datacenter

presence

Other Advanced Analytics

1. Data Factory(Preview)

2. Stream Analytics

3. Machine Learning

4. Azure Search

Other Data Management Services

1. Azure Search

2. Document DB

Innovations in the last 18monthsIdentity & Access Management

Azure AD Premium & Standard1. Privileged Identity management(preview)2. Self Service app request(preview)3. Azure AD Device Registration 4. Self-Service application access requests(preview)5. Dynamic configuration of security groups’ membership (preview)6. Domain Services(preview)7. Password rollover(preview)8. Extend on-premises directories to the cloud (Dirsync new versions, Azure

AD Sync)9. Single sign-on to thousands pre-integrated popular SaaS applications10.User and group provisioning to 3rd party SaaS applications11.Self-service password reset with write-back to on-premises directories12.Group Management Delegation 13.Machine learning-based security and usage reports14.Logon screen and end-user environment customization15.Azure Multi-Factor Authentication 16.Cloud App Discovery : An easy way to discover SaaS applications used by

end-user17.Azure AD Application Proxy: Publish internal application to external users

Azure AD Basic1. Extend on-premises directories to the cloud (Dirsync

new versions, Azure AD Sync)2. Single sign-on to thousands pre-integrated popular SaaS

applications3. User and group provisioning to 3rd party SaaS

applications

Other Identity & Access Management Services4. Role Base Access Control(preview)

5. Azure RemoteApp

Azure Virtual Machine Extensions

What are they?

Azure VM Extensions

Receives meta-data to create Azure VM

REST APIsCreate new

VM

Azure Fabric Controller

Create VM

Provision VM

Provisioning success?

Install Azure Agent

Run VM extension

Fabric controller returns sucess

Fabric controller returns error

Yes

No

Azure portal, powershell, CLI, Fabric controller

Restart VM

Azure portal, powershell, CLI

Success

Error

Using Python

DemoIn the demo, I will run the Python code built on Azure Python SDK which creates a MySQL cluster using Chef Client. The Chef client will be auto-installed using Chef client VM extension feature

Python Code Walk through <<< Will add python code snippets here or open up the code and show it>>

Azure Resource Manager templateWill run through the template that the code generates which is submitted to Azure APIs for creation of VMs

© 2014 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.