Splunk @ Amazon Startup - Austin, TX - 9/11/2008

Post on 09-May-2015

2.407 views 0 download

description

Michael Wilde, Splunk Ninja, gives an overview of Splunk, and discusses ways in which Splunk has solved some of its challenges using Amazon\'s EC2 / S3 Web Service to accomplish business goals

Transcript of Splunk @ Amazon Startup - Austin, TX - 9/11/2008

The IT Search CompanyMichael Wilde, Director, SplunkPowered Associates

ninja

Imagine using the Internet without a search engine

The IT Search Company

The IT Search Company

Now imagine trying to find information buried in terabytes of data inside your data center

The IT Search Company

Splunk lets you search your entire IT infrastructure from one place in real time

The IT Search Company

Why Search?

The IT Search Company

Our IT infrastructures are too complex, dynamic, service oriented, virtualized and

mission critical. Existing management approaches haven’t kept up.

The IT Search Company

Search is scalable, versatile and keeps up with change. It turns

the data you already have into actionable information.

The IT Search Company

>Last 60 minutes

Search your IT infrastructure

OperationsTroubleshoot problems

The IT Search Company

>J2EE exception Last 60 minutes

Search your IT infrastructure

OperationsTroubleshoot problems

SecurityInvestigate attacks

The IT Search Company

>

Search your IT infrastructure

Last 24 hours

fail* password sshd

OperationsTroubleshoot problems

SecurityInvestigate attacks

ComplianceReporting and Controls

The IT Search Company

>

Search your IT infrastructure

file modify | chart by sourceLast 7 days

OperationsTroubleshoot problems

SecurityInvestigate attacks

ComplianceReporting and Controls

Business IntelligenceAnalyze transactions

The IT Search Company

>

Search your IT infrastructure

transaction fields=useridLast 7 days

OperationsTroubleshoot problems

SecurityInvestigate attacks

ComplianceReporting and Controls

Business IntelligenceAnalyze transactions

The IT Search Company

>

Search your IT infrastructure

transaction fields=useridLast 7 days

• Time search with interactive results

• Keyword search with quoted strings, wild cards, booleans and nesting

• Targeted field search

- Host, sources, events

- Custom fields

• Summary and statistical search

• Transaction search

• Right click integration with other applications

The IT Search Company

Search

• Save any search and run it on a schedule to create an alert

• Alerts can trigger notifications and/or actions based on the search results

• Notifications can be sent via email, SMS, RSS or SNMP and integrated with other management consoles

• Actions can trigger scripts to perform activities like restarting a server

The IT Search Company

Alert

The IT Search Company

Report• One click reports from search results

• Any field can be used to plot series

• Flexible chart outputs and formats

• Interactive charts provide one click drill down

• Select multiple fields to plot several series together

• Save knowledge to share with other users and groups- Searches- Alerts- Reports- Dashboards- Types, Tags, Actions

• Package knowledge as an application and share with other installations

The IT Search Company

Share

The IT Search Company

Visualize• Connect visualization apps to the

Splunk API

• Feed business intelligence and reporting applications with IT data using the Splunk API

• Create dynamic visualizations of data with using one of the Splunk SDKs- Flash- Python- C, C++- Java- .Net

Challenges solved with cloud computing

The IT Search Company

Running a Developers Camp

• First Splunk Developers Camp (August 4, 2008)

• 65 onsite, 298 watching live via Splunk.TV

• Give dev’s a place to work they can self administer, but how?

The IT Search Company

DevCamp - the Fabulatr

• Users don’t need AWS accounts

• Easy starting/stopping of EC2 instances

• Emails the instructions & SSH key

• Free, Open SourceKord Campbell, Chief Evangelist

The IT Search Company

DevCamp - the Fabulatr

• Users don’t need AWS accounts

• Easy starting/stopping of EC2 instances

• Emails the instructions & SSH key

• Free, Open SourceKord Campbell, Chief Evangelist

The IT Search Company

Sales Engineering

The IT Search Company

Sales Engineering

The IT Search Company

Sales Engineering

• Proofs of Concept (customer testing)

• Joint work with support

• A place to play

• Splunk Live Demos

The IT Search Company

Sales Engineering

• Proofs of Concept (customer testing)

• Joint work with support

• A place to play

• Splunk Live Demos

The IT Search Company

Sales Engineering

• Proofs of Concept (customer testing)

• Joint work with support

• A place to play

• Splunk Live Demos

The IT Search Company

Splunk Loves

The IT Search Company

Splunk Loves

•EC2 - running instances

The IT Search Company

Splunk Loves

•EC2 - running instances

•S3 - storing images

The IT Search Company

Splunk Loves

•EC2 - running instances

•S3 - storing images

•EBS - wicked laaarge disk storage & snapshotting

The IT Search Company

Splunk Loves

•EC2 - running instances

•S3 - storing images

•EBS - wicked laaarge disk storage & snapshotting

• Rightscale

The IT Search Company

Splunk Loves

•EC2 - running instances

•S3 - storing images

•EBS - wicked laaarge disk storage & snapshotting

• Rightscale

• Rightscale

The IT Search Company

Splunk Loves

•EC2 - running instances

•S3 - storing images

•EBS - wicked laaarge disk storage & snapshotting

• Rightscale

• Rightscale

•Rightscale

The IT Search Company

The IT Search Company

The IT Search Company

The IT Search Company

powered

The IT Search Company

Resources for You

download.splunk.com

rightscale.com

EC2 Fabulatr code.google.com/p/fabulatr

The IT Search Company

Questions