WP4-QoS Management in the Cloud

Quality Management in Service-based Systems and

Cloud Applications

WP4 Quality Management and Business Model Innovation

RELATE-ITN

Dr. Jose María Alvarez-RodríguezResearch Fellow, SEERC

Prague, 19-04-2013

Prague, Czech Republic

“Cloud-based services acquire a particular quality by constantly acting a particular way... they become just by performing just actions, temperate by performing temperate actions, brave by performing brave actions.”

16/04/2013 #2

Aristotle

“Men acquire a particular quality by constantly acting a particular way... you become just by performing just actions, temperate by performing temperate actions, brave by performing brave actions.”

…we need to manage this particular way of acting!

Some time ago…

Which kind of quality do you prefer?

Prague, Czech Republic16/04/2013 #4

I need help…

I have a mobile application that needs a Geocoding service and the response time must be in milliseconds.

• More than 54 geocoding APIs– How can I select the most suitable service?– How can I compare different providers?– How can I track the quality (response time) of the selected

service?– …

http://blog.programmableweb.com/2012/06/21/7-free-geocoding-apis-google-bing-yahoo-and-mapquest/


Context

A growing offering of cloud services …more complexity

…new needs and requirements Cloud Management for…

Cloud models and types Track and control my third-party dependencies Context-aware quality dimensions/indicators/metrics

Security, storage, etc.Subjective experience

…to improve, optimize and accomplish… efficiency, costs, SLAs, etc. by means of providing advanced services

Analytics/Prediction/…

#516/04/2013 Prague, Czech Republic

#6

Cloud Computing

On-demand

self-service

Broad network access

Resource pooling

Rapid elasticity

Measured service

Source: The NIST Definition of Cloud Computing

?

What kind of service we want to track…

What kind of characteristics are applicable to that service…

What kind of operation should be deliver…

alert service, analytics, prediction?

16/04/2013 Prague, Czech Republic

What is “Quality”?Classical view

Dimensions Tangibles Reliability Responsiveness Service assurance Empathy Others…

Competence Credibility Security Access

Gaps Consumer expectation and

management perception Management perception

and service quality specification

Service quality specification and service delivery

Service delivery and external communication

Expected service and experienced service


#8

Monitoring tool (execution environment)

Continuous assurance Analytics Prediction

Quality Model

CustomerProfile

Cloud Service Profile

Mapping & configuration

Type of operationDashboard

-

A

bstr

actio

n

+

…

Dom

ain

know

ledg

eH

igh-

leve

lto

ols

Built

-ins

serv

ices

+

E

xecu

tabl

e

-

……

… …


Overview of a QoS Management Architecture

State-of-the-Art

Cloud Management Application Platforms

QoS Models Monitoring tools and techniques Execution environments (Big Data analytics)

#9

…

* Rodríguez, J. M. A; Kourtesis, D.; Paraskakis, I. Semantic based QoS management in Cloud Systems: Current Status and Future Challenges. Future Generation Computer Systems, Special Issue on Semantic Technologies and Linked Data over Grid and Cloud Architectures. IF: 1.978 (2012). (Under review).

…


http://www.cloudyn.com

http://www.rightscale.com/ http://www.enstratius.com/

http://scalr.com https://www.cloudexpress.com/

https://app.cloudability.com/analytics

Prague, Czech Republic #1116/04/2013

Some existing QoS models…


#13

Some existing monitoring techniques and tools…


Approach

#14

• Concepts & relationships • Dimensions, indicators and metrics• Service and Customer profile• Reuse of existing vocabularies and standards

Abstract Model of Qos Management

• Standard, common and shared data model• data integration through semantic technologies

• Configuration• Dashboard• Qualify Functions deployment (aggregation operators)

Mapping and High-level tools

• Monitoring tool• Continuous queries• Connection to data sources• ~Google analytics or Google Trends for QoS in cloud systems

Execution



Partial Data modelOverview

*Reuse of existing models and standards are not included.


I still need help…

I have a mobile application that needs a Geocoding service and the response time must be in milliseconds.

• More than 54 geocoding APIs– How can I select the most suitable service?– How can I compare different providers?– How can I track the quality (response time) of the selected

service?– …




My Profile (partial)


A Provider Profile (partial)

Key points Represent providers and my own QoS features in a common,

shared and standard way to be able to consume and make comparisons (information and data):

E.g. compare metrics with different units, seconds and milliseconds

Map providers API information to the QoS model Connectivity parameters Data

Deploy the quality function and Track the services with the monitoring tool

Select “the best” according to my target profile


Prague, Czech Republic #2016/04/2013

* A toy example of monitoring the use of words in Tweeter

#21

Storm

TridentReal-time

views

Batchviews

Storm

Trident

Algorithms Sync

Registered Queries(Quality Functions)

Results

Monitoring tool


Benefits

#22

• Integrated and Unified view of QoS• Extensibility

Abstract Model Qos Management

• Standard, common and shared data model (maybe semantically-based )• (Semi)-Automatic deployment of Quality Functions• Expressivity and Analytics

Mapping and High-level tools

• Real time capabilities• Big Data processing• Flexibility & scalability

Execution


Open Questions

#23

Motivating Scenario

• Bottom-up approach

Design a QoS model

Select cloud type and model

Design management

services

Execute and test


Situated QoS

#24

… can a broker take advantage of the QoS management?


Research Questions Which are the concepts and relationships to take into account

in QoS management? subjective and objective

Which services must be provided to exploit domain knowledge and which algorithms are necessary to afford those services?

How can we deal with the processing of heterogeneous data streams (Big Data) in real-time?

How can we find services according to customer profile (matchmaking)?

How can we exploit the historical information and feedback the domain knowledge?


Next Steps1. Design and deploy a complete example (iteratively)

1. Design a simple model covering some QoS features2. Map the model and QoS features to 1 service and n providers3. Deploy (semi-automatically) the quality function in the monitoring tool4. Improve the monitoring tool5. Check results

2. Go in-depth in the concept of “Quality” and “Measured service”

3. Look for synergies4. Design of experiments and writing

1. Can I easily extend the QoS model? (extensibility)2. Can I design and deploy quality analytic functions more fast? (expressivity)3. Can I meet (first) the “customer” requirements? (flexibility & scalability)


Publications Rodríguez, J. M. A; Kourtesis, D.; Paraskakis, I. Semantic based QoS management in

Cloud Systems: Current Status and Future Challenges. Future Generation Computer Systems, Special Issue on Semantic Technologies and Linked Data over Grid and Cloud Architectures. IF: 1.978 (2012). (Under review).

Others derivate of previous works (SCP and CHB journals) Talks

Seminar at SEERC on the topic: “Towards a Pan – European E-Procurement Platform to aggregate, publish, and search public procurement notices powered by Linked Open Data: The Moldeas Approach”. 22 February 2013.

PC member and reviewer PC member DATAWEB (PCI 2013), ETAS 2013, ICOHT 2013 and DMoLD workshop Reviewer of JCR Journals: FGCS, ESWA and Current Topics in Medicinal Chemistry Technical Development Editor in Manning Co. Member of the Advisory Board in two books of IGI-Global.

Training Seminar on OpenTosca

Prototypes An early prototype of a real-time platform for dealing with data streams and execute simple rules is

now available (documentation and source code). #27

Activities


http://www.journals.elsevier.com/future-generation-computer-systems/calls-for-papers/semantic-technologies-and-linked-data/

http://www.journals.elsevier.com/future-generation-computer-systems/calls-for-papers/semantic-technologies-and-linked-data/

https://github.com/chemaar/seqos/wiki/ToyLambdaArchitecture

https://github.com/chemaar/seqos/tree/master/prototypes/relatweet

Summary

M. Maiya, S. Dasari, R. Yadav, S. Shivaprasad, and D.S. Milojicic, "Quantifying Manageability of Cloud Platforms", ;in Proc. IEEE CLOUD, 2012, pp.993-995.

“A Runtime Quality Measurement Framework for Cloud Database Service Systems”, 8th Int. Conf. on the Quality of Information and Communications Technology // Lisbon, Portugal, 2012

N. Marz and J. Warren, “Big Data Principles and best practices of scalable realtime data systems”, Manning Publications, 2013.

#29

Main References


Questions

Thank you for your attention!

Credits• Acknowledgements– SEERC

• CONTACT AND RESOURCES– E-MAIL: [email protected]– WWW: http://josemalvarez.es– http://www.slideshare.net/josemalvarez

• Pictures– https://moqups.com

– NIST, Gartner, FP7 Europe, FLICKR– Cloud vendors

• License– http://creativecommons.org/licenses/by-nc-sa/3.0/es/

http://www.slideshare.net/josemalvarez





https://moqups.com/

http://creativecommons.org/licenses/by-nc-sa/3.0/es/

#32

Public Hybrid Private

SaaS

PaaS

IaaS

Control and governance

Abst

racti

on

Economies of scale

Flexibility


#33

Private(On-Premise)

Storage

Server HW

Networking

Servers

Databases

Virtualization

Runtimes

Applications

Security & Integration

You m

anag

e

Data / Users

Infrastructure

(as a Service)

Storage

Server HW

Networking

Servers

Databases

Virtualization

Runtimes

Applications

Security & Integration

Managed b

y v

endor

You m

anage

Data / Users

Platform(as a Service)

Storage

Server HW

Networking

Servers

Databases

Virtualization

Runtimes

Applications

Security & Integration M

anaged b

y v

endor

You m

anage

Data / Users

Software(as a Service)

Storage

Server HW

Networking

Servers

Databases

Virtualization

Runtimes

Applications

Security & Integration M

anaged b

y v

endor

Data / Users

You m

anage

Source: “Cloud Manageability”, Michael Epprecht , Microsoft Corp.16/04/2013 Prague, Czech Republic

WP4-QoS Management in the Cloud

Travel

Transcript of WP4-QoS Management in the Cloud