Goldstone Overview

Accelerating Adoption of Open Infrastructure

May 2014

Goldstone Overview

Copyright 2014 Solinea, Inc.

Solinea at a GlanceCUSTOMERSOVERVIEW

Industry Focus Open Infrastructure, OpenStack

Headquarters San Francisco, CA

Founded January 2013

Geographies Asia, USA

PAST DEPLOYMENTSTEAM

Major US Telco

US Infrastructure Service Provider

North Asian Telco

Global Electronics Manufacturer

Global Gaming Company

Top 5 Global Automotive Firm

Tier 1 Network Provider

Risk Management Analytics

Easter Europe CSP

OpenStack Distro Provider

Security Analytics Firm

Leading SDN Provider


Solinea Services

Conceive Architect Integrate Adopt

Conceive the cloud strategy for existing and new cloud services to drive customer adoption

Architect the cloud platforms based on market demand and internal capabilities

Implement the cloud offerings and integrate them into the existing infrastructure & processes

Operate the cloud, transfer knowledge, train the team and enable rapid adoption


Complexity Reigns in Cloud (not just OpenStack)


Same Problems, Different Clouds

• Every cloud Solinea built needed operational tools

• Tired of integrating series of expensive tools that didn’t exactly match the need …


Cloud Operators Need ToolsRequire full FCAPS suite of functionality

FaultConfigurationAccountingPerformanceSecurity

Need history to determine normal operationsTroubleshooting is very important


Existing OpenStack Tools Ceilometer

Metering toolAimed at

accounting information of FCAPS model

No managementNo troubleshooting

HorizonCloud user focusedNo historySecurity challengesNo troubleshootingSynchronous only -

no scheduling of tasks


Common Monitoring ToolsNagios and Zabbix

Monitoring tool only - no management capabilities

Scalability issues for larger cloud Not OpenStack specific - requires significant

customizationRequires agents on each node


Areas of Focus

Discover• Map OpenStack

topology• Present map

view for sysadmin

Report• Display key

metrics specific to OpenStack

• Alert sysadmin on abnormalities

Analyze• Calculate key

indicators• Provide guidance

on troubleshooting


Manage and Monitor OpenStack

http://gssr.jpl.nasa.gov/index.html

The Goldstone Deep Space Communications Complex (GDSCC), commonly called the Goldstone Observatory, islocated in the U.S. state of California's Mojave Desert. Operated for the Jet Propulsion Laboratory, its main purposeis to track and communicate with space missions. It is named after Goldstone, California, a nearby gold-miningghost town.

(Because everyone asks…)


Cross-Product Resource View

• Service resource view

of OpenStack cloud

topology• Self-discovered and

auto-updating• Discovers across

availability zones• Drills down into

individual services


Nova Discovery View


Cinder Discovery View


Detailed Resource Inspection

Popup provides full details on the chosen resource


Glance Discovery View


Keystone Discovery View


Log Viewing, Filtering, and Searching


API Performance

• Database keeps

long history of

events• Analysis to

provide key

performance

metric - API

response time


Key Metric Reporting


Goldstone Architecture


Anatomy of an OpenStack Message

Most projects use a similar format– Date: 2014-05-02 14:10:57.278– PID: 3609– Level: INFO– Prog: oslo.messaging._drivers.impl_qpid– ID: [-]– Msg: Connected to AMQP …


Shipping via rsyslog (conf.d)

rsyslog.d/10-goldstone.conf file:$WorkDirectory /var/lib/rsyslog # where to place spool files$ActionQueueFileName fwdGoldstone # unique name prefix for spool files$ActionQueueMaxDiskSpace 1g # 1gb space limit (use as much as possible)$ActionQueueSaveOnShutdown on # save messages to disk on shutdown$ActionQueueType LinkedList # run asynchronously$ActionResumeRetryCount -1 # infinite retries if host is down

local0.* @@10.10.11.122:5514 # novalocal1.* @@10.10.11.122:5514 # glancelocal2.* @@10.10.11.122:5514 # neutronlocal3.* @@10.10.11.122:5514 # ceilometerlocal4.* @@10.10.11.122:5514 # swiftlocal5.* @@10.10.11.122:5514 # cinderlocal6.* @@10.10.11.122:5514 # keystone


Logstash Input

input { tcp { port => 5514 # matches port that rsyslog ships to type => syslog # insert a type field to identify this as an incoming message from syslog }}


Logstash Filtering

filter { magic_happens_here: { tokenizing, pattern matching, categorization, transformation, etc. }}


Logstash Output

output { elasticsearch { host => localhost port => 9200 protocol => http }}


Result in ES:

photo credit: <a href="http://www.flickr.com/photos/robbie73/4346732208/">Robbert van der Steeg</a> via <a href="http://photopin.com">photopin</a> <a href="http://creativecommons.org/licenses/by-sa/2.0/">cc</a>


Goldstone AvailabilityCurrently in early access programAvailable free of chargeSending out batches of installations in weekly

waves for support reasons (installer)Next batch goes out on June 15th

Tell us about your environment and register: http://www.solinea.com/goldstone

http://www.solinea.com/goldstone


Goldstone RequirementsGoldstone server

4GB RAMx64 CPUCentOS / RHEL 6.5

Network access to OpenStack servers on management networkLogs need to be forwarded to this server

Requires OpenStack Icehouse


Goldstone RoadmapRegular point release updates during OpenStack

development periodsReleasing version 1 (“Asteroid”) now

Major release to coincide with OpenStack Juno release in OctoberVersion 2 due at OpenStack Summit Paris

(“Blackhole”)Concentrating on reporting and analysis features

John Stanford, VP Development; [email protected] Pepple, CTO; [email protected]

Thank You

Goldstone Overview

Technology

Transcript of Goldstone Overview