Xen Orchestra: XAPI and XenServer from the web-XPUS13 Lambert

41
http://xen-orchestra.com Vates : Open source solutions http://vates.fr Xen Orchestra Olivier Lambert XO Project Leader [email protected] 1/41 Xen + XAPI from the Web

description

Xen Orchestra is a web based management tool for the XAPI toolstack that is developed by the Xen Project. XAPI is a fully featured management API for Xen, that is also used by the recently open sourced enServer. We'll see how Xen Orchestra leverages XAPI by allowing a complete control of your virtualized infrastructure. First, we'll explain quickly the XO architecture (such as cache system, asynchronous events, user management with tokens…) Then, a review of current and future possibilities will be exposed, to show what you can expect from this solution: powerful visualizations with d3js, neat interface, orchestration features and integration with all XAPI's capable hosts (XenServer or any distro with XAPI packages, such as Debian, Ubuntu or CentOS). Finally, we'll talk about how to contribute.

Transcript of Xen Orchestra: XAPI and XenServer from the web-XPUS13 Lambert

Page 1: Xen Orchestra: XAPI and XenServer from the web-XPUS13 Lambert

http://xen-orchestra.comVates : Open source solutions

http://vates.fr

Xen Orchestra

Olivier LambertXO Project Leader

[email protected]

1/41

Xen + XAPI from the Web

Page 2: Xen Orchestra: XAPI and XenServer from the web-XPUS13 Lambert

LinuxCon / Xen User Summit 2013 - http://xen-orchestra.comVates : Open source solutions

http://vates.fr

Plan

1) Why Xen Orchestra?

2) Global design

3) Current state

4) Next steps

5) Conclusion

2/41

Page 3: Xen Orchestra: XAPI and XenServer from the web-XPUS13 Lambert

LinuxCon / Xen User Summit 2013 - http://xen-orchestra.comVates : Open source solutions

http://vates.fr

Why Xen Orchestra?

3/41

Page 4: Xen Orchestra: XAPI and XenServer from the web-XPUS13 Lambert

LinuxCon / Xen User Summit 2013 - http://xen-orchestra.comVates : Open source solutions

http://vates.fr

Why Xen Orchestra?

● XO was born because of this question:

'On which host is running my VM, goddammit?'

● Then I searched something which:

– Provides a Web interface for managing Xen

– Gives a global overview of VMs and their hosts

– Makes every day Xen administration easier

4/41

Page 5: Xen Orchestra: XAPI and XenServer from the web-XPUS13 Lambert

LinuxCon / Xen User Summit 2013 - http://xen-orchestra.comVates : Open source solutions

http://vates.fr

Why Xen Orchestra?Timeline

First XO XCP 1.0

2009 2010 2011 2012 2013

XenServer opensourced

XO “reboot”

Project discontinued

5/41

Page 6: Xen Orchestra: XAPI and XenServer from the web-XPUS13 Lambert

LinuxCon / Xen User Summit 2013 - http://xen-orchestra.comVates : Open source solutions

http://vates.fr

Why Xen Orchestra?The reboot

● Get a simple and neat GUI for Xen

● Enjoy it with latest web technologies

● Embrace and leverage XAPI possibilities

● Driven by Open source (AGPL)

● Company support (Vates)

6/41

Page 7: Xen Orchestra: XAPI and XenServer from the web-XPUS13 Lambert

LinuxCon / Xen User Summit 2013 - http://xen-orchestra.comVates : Open source solutions

http://vates.fr

Why Xen Orchestra?Ideal specifications

● Accessible from a web browser

● Work out of the box

● Cover everyday Xen administration tasks

● Innovative interface

● Use few resources (bandwidth/cpu/ram)

● Scalable design

7/417/41

Page 8: Xen Orchestra: XAPI and XenServer from the web-XPUS13 Lambert

LinuxCon / Xen User Summit 2013 - http://xen-orchestra.comVates : Open source solutions

http://vates.fr

Why Xen Orchestra?What is NOT XO

● NOT a clone of XenCenter (but share the goal)

● NOT a cloud manager (e.g: OpenStack)

● NO specific agent to install on hosts or VMs

● NO complicated stack to install

8/41

Page 9: Xen Orchestra: XAPI and XenServer from the web-XPUS13 Lambert

LinuxCon / Xen User Summit 2013 - http://xen-orchestra.comVates : Open source solutions

http://vates.fr

Why Xen Orchestra? Existing GUI's for XAPI hosts

● XenCenter: Windows only (Mono?), rich client, no persistence

● Open Xen Manager: XenCenter's clone, rich client, no persistence (last ver: 2010)

● Lot of small and/or dead projects without communities

● Specific projects: VPS vendors, big cloud interfaces (like Cloudstack or OpenStack)

A gap exists for XO

9/41

Page 10: Xen Orchestra: XAPI and XenServer from the web-XPUS13 Lambert

LinuxCon / Xen User Summit 2013 - http://xen-orchestra.comVates : Open source solutions

http://vates.fr

Global design

10/41

Page 11: Xen Orchestra: XAPI and XenServer from the web-XPUS13 Lambert

LinuxCon / Xen User Summit 2013 - http://xen-orchestra.comVates : Open source solutions

http://vates.fr

Global designWhy XAPI?

● XenServer have Xen+XAPI

● XAPI available on other distros (Debian/CentOS)

● Most versatile and feature-complete stack (pools...)

● XAPI is the backbone for existing management apps (XenCenter, xe CLI, {Open,Cloud}Stack)

11/41

Page 12: Xen Orchestra: XAPI and XenServer from the web-XPUS13 Lambert

LinuxCon / Xen User Summit 2013 - http://xen-orchestra.comVates : Open source solutions

http://vates.fr

Global designWhy XAPI?

● Event tracking with progress and notifications: perfect for XO! (always up to date, bandwidth friendly)

● Resource pools

● Storage

● VM lifecycle

● And many more!

12/41

Page 13: Xen Orchestra: XAPI and XenServer from the web-XPUS13 Lambert

LinuxCon / Xen User Summit 2013 - http://xen-orchestra.comVates : Open source solutions

http://vates.fr

Global designArchitecture

● Modular architecture:– XO-Server: persistence, connections, ACL's...

– XO-Web: interface

● Benefits:– Uncouple interface project from backend

– Change interface or backend painlessly

– And more...

13/41

Page 14: Xen Orchestra: XAPI and XenServer from the web-XPUS13 Lambert

LinuxCon / Xen User Summit 2013 - http://xen-orchestra.comVates : Open source solutions

http://vates.fr

Global designXO Architecture

14/41

Page 15: Xen Orchestra: XAPI and XenServer from the web-XPUS13 Lambert

LinuxCon / Xen User Summit 2013 - http://xen-orchestra.comVates : Open source solutions

http://vates.fr

Global designXO Architecture

15/41

Page 16: Xen Orchestra: XAPI and XenServer from the web-XPUS13 Lambert

LinuxCon / Xen User Summit 2013 - http://xen-orchestra.comVates : Open source solutions

http://vates.fr

Global designExample

XS Master

XS host3

XS host2

XS host 4

XS host 5

Pool 1

16/41

Page 17: Xen Orchestra: XAPI and XenServer from the web-XPUS13 Lambert

LinuxCon / Xen User Summit 2013 - http://xen-orchestra.comVates : Open source solutions

http://vates.fr

Global designExample (XenCenter)

XS Master

XS host3

XS host2

XS host 4

XS host 5

Pool 1 XenCenterClient 1

XenCenterClient 2

XenCenterClient 3

17/41

Page 18: Xen Orchestra: XAPI and XenServer from the web-XPUS13 Lambert

LinuxCon / Xen User Summit 2013 - http://xen-orchestra.comVates : Open source solutions

http://vates.fr

Global designExample (XO)

XS Master

XS host3

XS host2

XS host 4

XS host 5

Pool 1

XO

WebClient 1

WebClient 3

WebClient 2

+ cache

18/41

Page 19: Xen Orchestra: XAPI and XenServer from the web-XPUS13 Lambert

LinuxCon / Xen User Summit 2013 - http://xen-orchestra.comVates : Open source solutions

http://vates.fr

Global designTechnologies

● Rebooted with PHP again● Not great for dealing with servers● XML-RPC bugs in PHP lib● Exterior criticism about this choice

We looked for a better fit

19/41

Page 20: Xen Orchestra: XAPI and XenServer from the web-XPUS13 Lambert

LinuxCon / Xen User Summit 2013 - http://xen-orchestra.comVates : Open source solutions

http://vates.fr

Global designTechnologies for XO-Server

● Node.js seems promising● Less complexity than PHP● Better maintenance● Adapted design for our needs● Easy to interact with Redis (NoSQL)

20/41

Page 21: Xen Orchestra: XAPI and XenServer from the web-XPUS13 Lambert

LinuxCon / Xen User Summit 2013 - http://xen-orchestra.comVates : Open source solutions

http://vates.fr

Global designTechnologies for XO-Web

● Single page app (much faster)● Backbone.js (Marionette.js)● WebSocket● Twitter Bootstrap● No more PHP, only JavaScript

21/41

Page 22: Xen Orchestra: XAPI and XenServer from the web-XPUS13 Lambert

LinuxCon / Xen User Summit 2013 - http://xen-orchestra.comVates : Open source solutions

http://vates.fr

Global designUI Design

● The most challenging part● Data density, diversity and redundancy● 2 parallel choices :

– Traditional solutions (tables) but always “light”

– Innovative design allows more data density

● UI research is a priority

22/41

Page 23: Xen Orchestra: XAPI and XenServer from the web-XPUS13 Lambert

LinuxCon / Xen User Summit 2013 - http://xen-orchestra.comVates : Open source solutions

http://vates.fr

Global designClassical design

23/41

Page 24: Xen Orchestra: XAPI and XenServer from the web-XPUS13 Lambert

LinuxCon / Xen User Summit 2013 - http://xen-orchestra.comVates : Open source solutions

http://vates.fr

Global designInnovative design

● Great JS lib: D3.js (http://d3js.org/)● Plenty of examples for dealing data complexity● Mixing symbols for displaying multiples data

And we have a Software ergonomist

24/41

Page 25: Xen Orchestra: XAPI and XenServer from the web-XPUS13 Lambert

LinuxCon / Xen User Summit 2013 - http://xen-orchestra.comVates : Open source solutions

http://vates.fr

Global designExample

25/41

Page 26: Xen Orchestra: XAPI and XenServer from the web-XPUS13 Lambert

LinuxCon / Xen User Summit 2013 - http://xen-orchestra.comVates : Open source solutions

http://vates.fr

Global designExample

26/41

Page 27: Xen Orchestra: XAPI and XenServer from the web-XPUS13 Lambert

LinuxCon / Xen User Summit 2013 - http://xen-orchestra.comVates : Open source solutions

http://vates.fr

Current state

27/41

Page 28: Xen Orchestra: XAPI and XenServer from the web-XPUS13 Lambert

LinuxCon / Xen User Summit 2013 - http://xen-orchestra.comVates : Open source solutions

http://vates.fr

Current statePlug and play

● Distributed in xva appliance:– Download

– Import

– Go on its IP in your browser

– That's it!

● No overkill stack for “just” Xen admin

28/4128/41

Page 29: Xen Orchestra: XAPI and XenServer from the web-XPUS13 Lambert

LinuxCon / Xen User Summit 2013 - http://xen-orchestra.comVates : Open source solutions

http://vates.fr

Current stateFeatures

● Works out the box for XenServer/XAPI hosts:– Tested on Debian+XAPI and XS 6.2

● Overview panel● VMs list● VMs consoles in Firefox● Local users and permissions

29/41

Page 30: Xen Orchestra: XAPI and XenServer from the web-XPUS13 Lambert

LinuxCon / Xen User Summit 2013 - http://xen-orchestra.comVates : Open source solutions

http://vates.fr

Current stateFeatures

30/41

Page 31: Xen Orchestra: XAPI and XenServer from the web-XPUS13 Lambert

LinuxCon / Xen User Summit 2013 - http://xen-orchestra.comVates : Open source solutions

http://vates.fr

Current stateFeatures

31/41

Page 32: Xen Orchestra: XAPI and XenServer from the web-XPUS13 Lambert

LinuxCon / Xen User Summit 2013 - http://xen-orchestra.comVates : Open source solutions

http://vates.fr

Current stateFeatures

32/41

Page 33: Xen Orchestra: XAPI and XenServer from the web-XPUS13 Lambert

LinuxCon / Xen User Summit 2013 - http://xen-orchestra.comVates : Open source solutions

http://vates.fr

Current stateFeatures

33/41

Page 34: Xen Orchestra: XAPI and XenServer from the web-XPUS13 Lambert

LinuxCon / Xen User Summit 2013 - http://xen-orchestra.comVates : Open source solutions

http://vates.fr

Current stateFeatures

34/41

Page 35: Xen Orchestra: XAPI and XenServer from the web-XPUS13 Lambert

LinuxCon / Xen User Summit 2013 - http://xen-orchestra.comVates : Open source solutions

http://vates.fr

Current stateFeatures

35/41

Page 36: Xen Orchestra: XAPI and XenServer from the web-XPUS13 Lambert

LinuxCon / Xen User Summit 2013 - http://xen-orchestra.comVates : Open source solutions

http://vates.fr

Next steps

36/41

Page 37: Xen Orchestra: XAPI and XenServer from the web-XPUS13 Lambert

LinuxCon / Xen User Summit 2013 - http://xen-orchestra.comVates : Open source solutions

http://vates.fr

Next stepsShort term (2013)

● Creating and managing VM/storage/network● LDAP compatible backend● Instant report and graphs with RRD's● More innovative views● Distro packaging

37/41

Page 38: Xen Orchestra: XAPI and XenServer from the web-XPUS13 Lambert

LinuxCon / Xen User Summit 2013 - http://xen-orchestra.comVates : Open source solutions

http://vates.fr

Next stepsMid-term (2014)

● Stable release● Possibility of pro support or sponsoring● Trends (RRD history, workload analysis)● Possibilities with modular architecture:

– Other backend? (only change XO-Server)

– Research projects

38/41

Page 39: Xen Orchestra: XAPI and XenServer from the web-XPUS13 Lambert

LinuxCon / Xen User Summit 2013 - http://xen-orchestra.comVates : Open source solutions

http://vates.fr

Conclusion

39/41

Page 40: Xen Orchestra: XAPI and XenServer from the web-XPUS13 Lambert

LinuxCon / Xen User Summit 2013 - http://xen-orchestra.comVates : Open source solutions

http://vates.fr

Conclusion

● Website drained 4k unique visitors in August● Visits from more than 100 countries● Early users are enthusiasts● Expectations are high● Understaffing limits our developing rate

40/41

Page 41: Xen Orchestra: XAPI and XenServer from the web-XPUS13 Lambert

LinuxCon / Xen User Summit 2013 - http://xen-orchestra.comVates : Open source solutions

http://vates.fr

Thank you!

● Website project: http://xen-orchestra.com● Forum: http://xen-orchestra.com/forum● IRC: #vates on Freenode● Twitter: @vatesfr

Come talk to us after this talk

We'll be available here until Friday

41/41