API Best Practices Webinar: Metrics - What to Measure
57
API Metrics – What to Measure? 6.2.11 @ 11:05 PST VOIP or Dialin (see chat) Brian Mulloy @landlessness Brian Pagano @brianpagano
-
Upload
apigee -
Category
Technology
-
view
14.545 -
download
3
description
Part 4 in our series of API Best Practices Webinars - on API Metrics: What to Measure - by @landlessness and @brianpagano
Transcript of API Best Practices Webinar: Metrics - What to Measure
API Metrics – What to Measure?
6.2.11 @ 11:05 PST VOIP or Dial-‐in (see chat)
Brian Mulloy @landlessness
Brian Pagano @brianpagano
@landlessness @brianpagano
Mapping out your API Strategy
PragmaIc REST: API Design Fu
10 PaMerns in Successful API Programs
Today: API Metrics – What to Measure?
API Tech & Roadmap ConsideraIons
Driving API AdopIon
“Rapid API” Workshop Webinar Series
Part 4: API Metrics – What to Measure?
Successful API teams understand the value chain of people and technology.
App User
API Team API App World of
APIs App
Store Internal Systems
App Developer
Two sets of people make APIs successful
App User
API Team API App World of
APIs App
Store Internal Systems
App Developer
App User
API Team API App World of
APIs App
Store Internal Systems
App Developer
Jason Michael
What does the ApplicaIon Developer need to see?
App User
API Team API App World of
APIs App
Store Internal Systems
App Developer
App User
API Team API App World of
APIs App
Store Internal Systems
App Developer
App User
API Team API App World of
APIs App
Store Internal Systems
App Developer
hufse
Is the API error prone?
Which API errors is my applicaIon seeing?
How does the API usually perform?
Is the API slow now?
Which API methods are slow?
Does the API have a quota?
Is my app violaIng the API quota?
How o[en does the API go down?
Is the API down now?
When will the API be back up?
Why was the API down?
Dan DeChiaro
What’s in your dashboard?
There are a few key indicators in a few formats
Key indicators: • Errors • Performance • Availability • Quota (if enforced)
Data Formats: • Everyone’s aggregate data • Developer-‐specific data • Trend charts • Categorical tables
Broadcast Formats: • Status page • TwiMer • Blog
What does the API Team need to see?
App User
API Team API App World of
APIs App
Store Internal Systems
App Developer
App User
API Team API App World of
APIs App
Store Internal Systems
App Developer
Almost everything
Thai Jasmine (Keep Smiling.g..g.g :-‐))
Which are our top applicaIons?
Who are our top applicaIon users?
Who are our best applicaIon developers?
Which API methods are most popular?
How much API capacity will we need next year?
Raymond Larose
Why is the API down?
Why is the API slow?
Why is the API throwing errors?
Why is the API traffic spiking?
Why did the API traffic disappear?
Dan DeChiaro
Key indicators: • ApplicaIon users • ApplicaIons • Developers • API Quality • Internal systems
Data Formats: • Alerts • Aggregate data • Drill-‐down data • Trend charts • Categorical tables
What about the stuff behind the API?
App User
API Team API App World of
APIs App
Store Internal Systems
App Developer
TIP: Put Internal System Data in Response Header • Database Query Times • Message Bus Response Times • External Callout Response Times
(Apigee will log it & strip it)
trochim
Operations
Developer Connect
API Gateway
App D
ev Analytics
Operations Team Monitoring
AP
I Tea
m A
naly
tics
Developer Tools Availability Errors Performance Quota
Developers Applications App Users API Quality
Availability Performance Capability
Application Developer API Team
Mapping out your API Strategy PragmaIc REST: API Design Fu 10 PaMerns in Successful API Programs API Metrics – What to Measure? API Tech & Roadmap ConsideraAons Driving API AdopIon
Next Time
THANK YOU Ques%ons and ideas to: @landlessness @brianpagano @apigee
