Post on 26-Jan-2015
description
Accelerating Adoption of Open Infrastructure
May 2014
Goldstone Overview
Copyright 2014 Solinea, Inc.
Solinea at a GlanceCUSTOMERSOVERVIEW
Industry Focus Open Infrastructure, OpenStack
Headquarters San Francisco, CA
Founded January 2013
Geographies Asia, USA
PAST DEPLOYMENTSTEAM
Major US Telco
US Infrastructure Service Provider
North Asian Telco
Global Electronics Manufacturer
Global Gaming Company
Top 5 Global Automotive Firm
Tier 1 Network Provider
Risk Management Analytics
Easter Europe CSP
OpenStack Distro Provider
Security Analytics Firm
Leading SDN Provider
Copyright 2014 Solinea, Inc.
Solinea Services
Conceive Architect Integrate Adopt
Conceive the cloud strategy for existing and new cloud services to drive customer adoption
Architect the cloud platforms based on market demand and internal capabilities
Implement the cloud offerings and integrate them into the existing infrastructure & processes
Operate the cloud, transfer knowledge, train the team and enable rapid adoption
Copyright 2014 Solinea, Inc.
Complexity Reigns in Cloud (not just OpenStack)
Copyright 2014 Solinea, Inc.
Same Problems, Different Clouds
• Every cloud Solinea built needed operational tools
• Tired of integrating series of expensive tools that didn’t exactly match the need …
Copyright 2014 Solinea, Inc.
Cloud Operators Need ToolsRequire full FCAPS suite of functionality
FaultConfigurationAccountingPerformanceSecurity
Need history to determine normal operationsTroubleshooting is very important
Copyright 2014 Solinea, Inc.
Existing OpenStack Tools Ceilometer
Metering toolAimed at
accounting information of FCAPS model
No managementNo troubleshooting
HorizonCloud user focusedNo historySecurity challengesNo troubleshootingSynchronous only -
no scheduling of tasks
Copyright 2014 Solinea, Inc.
Common Monitoring ToolsNagios and Zabbix
Monitoring tool only - no management capabilities
Scalability issues for larger cloud Not OpenStack specific - requires significant
customizationRequires agents on each node
Copyright 2014 Solinea, Inc.
Areas of Focus
Discover• Map OpenStack
topology• Present map
view for sysadmin
Report• Display key
metrics specific to OpenStack
• Alert sysadmin on abnormalities
Analyze• Calculate key
indicators• Provide guidance
on troubleshooting
Copyright 2014 Solinea, Inc.
Manage and Monitor OpenStack
http://gssr.jpl.nasa.gov/index.html
The Goldstone Deep Space Communications Complex (GDSCC), commonly called the Goldstone Observatory, islocated in the U.S. state of California's Mojave Desert. Operated for the Jet Propulsion Laboratory, its main purposeis to track and communicate with space missions. It is named after Goldstone, California, a nearby gold-miningghost town.
(Because everyone asks…)
Copyright 2014 Solinea, Inc.
Cross-Product Resource View
• Service resource view
of OpenStack cloud
topology• Self-discovered and
auto-updating• Discovers across
availability zones• Drills down into
individual services
Copyright 2014 Solinea, Inc.
Nova Discovery View
Copyright 2014 Solinea, Inc.
Cinder Discovery View
Copyright 2014 Solinea, Inc.
Detailed Resource Inspection
Popup provides full details on the chosen resource
Copyright 2014 Solinea, Inc.
Glance Discovery View
Copyright 2014 Solinea, Inc.
Keystone Discovery View
Copyright 2014 Solinea, Inc.
Log Viewing, Filtering, and Searching
Copyright 2014 Solinea, Inc.
API Performance
• Database keeps
long history of
events• Analysis to
provide key
performance
metric - API
response time
Copyright 2014 Solinea, Inc.
Key Metric Reporting
DEMO
Copyright 2014 Solinea, Inc.
Goldstone Architecture
Copyright 2014 Solinea, Inc.
Anatomy of an OpenStack Message
Most projects use a similar format– Date: 2014-05-02 14:10:57.278– PID: 3609– Level: INFO– Prog: oslo.messaging._drivers.impl_qpid– ID: [-]– Msg: Connected to AMQP …
Copyright 2014 Solinea, Inc.
Shipping via rsyslog (conf.d)
rsyslog.d/10-goldstone.conf file:$WorkDirectory /var/lib/rsyslog # where to place spool files$ActionQueueFileName fwdGoldstone # unique name prefix for spool files$ActionQueueMaxDiskSpace 1g # 1gb space limit (use as much as possible)$ActionQueueSaveOnShutdown on # save messages to disk on shutdown$ActionQueueType LinkedList # run asynchronously$ActionResumeRetryCount -1 # infinite retries if host is down
local0.* @@10.10.11.122:5514 # novalocal1.* @@10.10.11.122:5514 # glancelocal2.* @@10.10.11.122:5514 # neutronlocal3.* @@10.10.11.122:5514 # ceilometerlocal4.* @@10.10.11.122:5514 # swiftlocal5.* @@10.10.11.122:5514 # cinderlocal6.* @@10.10.11.122:5514 # keystone
Copyright 2014 Solinea, Inc.
Logstash Input
input { tcp { port => 5514 # matches port that rsyslog ships to type => syslog # insert a type field to identify this as an incoming message from syslog }}
Copyright 2014 Solinea, Inc.
Logstash Filtering
filter { magic_happens_here: { tokenizing, pattern matching, categorization, transformation, etc. }}
Copyright 2014 Solinea, Inc.
Logstash Output
output { elasticsearch { host => localhost port => 9200 protocol => http }}
Copyright 2014 Solinea, Inc.
Result in ES:
photo credit: <a href="http://www.flickr.com/photos/robbie73/4346732208/">Robbert van der Steeg</a> via <a href="http://photopin.com">photopin</a> <a href="http://creativecommons.org/licenses/by-sa/2.0/">cc</a>
Copyright 2014 Solinea, Inc.
Goldstone AvailabilityCurrently in early access programAvailable free of chargeSending out batches of installations in weekly
waves for support reasons (installer)Next batch goes out on June 15th
Tell us about your environment and register: http://www.solinea.com/goldstone
Copyright 2014 Solinea, Inc.
Goldstone RequirementsGoldstone server
4GB RAMx64 CPUCentOS / RHEL 6.5
Network access to OpenStack servers on management networkLogs need to be forwarded to this server
Requires OpenStack Icehouse
Copyright 2014 Solinea, Inc.
Goldstone RoadmapRegular point release updates during OpenStack
development periodsReleasing version 1 (“Asteroid”) now
Major release to coincide with OpenStack Juno release in OctoberVersion 2 due at OpenStack Summit Paris
(“Blackhole”)Concentrating on reporting and analysis features
John Stanford, VP Development; john@solinea.comKen Pepple, CTO; ken@solinea.com
Thank You