STPCon Fall 2012
-
date post
19-Oct-2014 -
Category
Documents
-
view
556 -
download
0
description
Transcript of STPCon Fall 2012
CONFERENCE FALL 2 012
Leadership Perspectives for Testers
Test Strategy, Process and
Design
Agile Testing
Performance Testing
Test Automation
Mobile Application
Testing
Strategic Business
Alignment
Hands-OnPracticals
T H e L e A D i n g C O n f e r e n C e O n S O f T w A r e T e S T i n g
www. ST P Co n .co m 8 7 7 . 2 5 7 . 9 5 3 1
Conference Tracks
OCTOber 15-18 MiaMi , flOridaTh
e Le
ad
ing
Co
nf
er
en
Ce
P a g e 2
regiSTer www.STPCon.com or call 877.257.9531
Conference Packages and PricingMain Conference Package Dates:Wednesday,October16–Friday,October18Price: $1,295.00onorbeforeSeptember7OR
$1,695.00afterSeptember7
n4ExceptionalKeynotesn50ConferenceBreakoutSessionsin
8ComprehensiveTracksnComprehensiveOnlineWebAccesstoAll
ConferenceSessionsandKeynotesnNetworkingActivitiesIncluding:SpeedGeeking
Sessions;Wrap-UpRoundtablesandSponsoredTopicRoundtableDiscussions
nTopIndustryVendorsandParticipationintheSponsorPrizeGiveaway
nThreeBreakfasts,TwoLunchesandHappyHourWelcomeReception
Main Conference Package PLUS 1-Day Dates:Tuesday,October15–Friday,October18Price: $1,695.00onorbeforeSeptember7OR
$2,095.00afterSeptember7
nIncludesALLoftheMainConferencePackageOfferings
nIncludeschoiceofa1-daypre-conferenceworkshopnIncludesapre-conferencebreakfastandlunch
RegistRation I N F O R M A T I O NDiscountsEarlyBirdDiscount:RegisteronorbeforeSeptember7toreceive$400.00offanyfullconferencepackage
Team Discounts
Number of Attendees
Rate Before Early Bird (9/7)
Rate After Early Bird (9/7)
1-2 $1,295 $1,695
3-5 $1,195 $1,395
6-9 $1,095 $1,295
10-14 $995 $1,195
15+ $895 $1,095
*Price above is for access to the Main Conference Package. Please add $400 to your registration if you are registering for the Main Conference Package PLUS 1-Day.
**Team discounts are not combinable with any other discounts/offers. Teams must be from the same company and should be submitted into the online registration system on the same day.
Coast to CoastCoast to CoastCONFERENCE & EXPO 2012
P a g e 3
Registration..........................................2-3
KeynotePresentations..........................4-5
ScheduleataGlance............................6-7
ConferenceTracks................................8-9
Pre-ConferenceWorkshops..............10-11
SessionBlock1................................12-13
SessionBlock2................................14-15
SessionBlock3................................16-17
SessionBlock4................................18-19
SessionBlock5................................20-21
SessionBlock6................................22-23
SessionBlock7................................24-25
SessionBlock8................................26-27
SessionBlock9................................28-29
SessionBlock10..............................30-31
Cancellation Policy:All cancellations must be made in writing. You may cancel without penalty until September 14, 2012 after which a $150 cancellation fee will be charged. No-shows and cancellations after September 28, 2012 will be charged the full conference rate. Cancellation policies apply to both conference and pre-conference workshop registrations.
Table of ConTenTs
Hilton Miami Downtown1601BiscayneBoulevard|Miami,FL33132
Adiscountedconferencerateof$129.00isavailableforconferenceattendees.Call1-800-HILTONSandreferenceGROUP CODE:STP2 / Software Test Professionals Conference rate orvisittheeventwebsiteatwww.stpcon.com/hoteltoreserveyourroomonline.RoomsareavailableuntilSeptember25oruntiltheysellout.Don’tmissyouropportunitytostayattheconferencehotel.
Platinum Sponsor
Conference Hotel
Coast to Coast Conferences Package(For 6 or More Registrations Only – Book Now and Choose Between 2 Conferences)
Dates: Software Test Professionals Conference Fall 2012 (October 16-18, 2012) AND Software Test Professionals Conference Spring 2013 (April 22-24, 2013)
Price: Take advantage of the team discounts listed below – but choose which conference each team member should attend. Register your entire team at the discounted rates listed on the Team Discount Chart below – and then decide which conference they should attend:
n Software Test Professionals Conference Fall 2012in Miami, FL on October 16-18, 2012 OR
n Software Test Professionals Conference Springin San Diego, CA on April 22-24, 2013
9 : 3 0 a m – 1 0 : 3 0 a m
P a g e 4
Tuesday, 16 octoberLEE HensonLEE HensonChiefAgileEnthusiastn AgileDad
Testing agility leads to business fragilityItcomesasnosurprisethatwiththedownfalloftheeconomyintheUS,manyorganizationshavemadetestinganafterthought.Somehavescaledtestingeffortsbacksofarthattheend
producthassufferedmoregreatlythanonecanimagine.Thisisresultinginmajorconsumerfrustrationandagreatlackoforganizationalunderstandingofhowbesttotacklethisissue.Agiledoesnotmeandomorewithless.Aswejourneyintoanewfrontierwheresmallerisbetter,lessismore,andfasterisalwaystherightanswer,traditionaltestingeffortshavebeenmorphedandpickedaparttoonlyincludethepartsthatpeoplewanttoseeandhear.Effectivetestingcanbedoneinanefficientmannerwithoutsacrificingqualityattheendoftheday.Learnbasedonrealworldscenarioshowothershavelearnedaboutandconqueredthisissue.Embarkonajourneywith‘ElyExecutive’asherealizesthevalueandimportanceofqualitytobothhisinternalandexternalcustomer.DiscoverhowahostofinternalandexternalplayershelpElyreachhisconclusionandbaskinthe‘Icanrelatetothat’syndromethisscenariopresents.Thisepicadventurewillsurelyprovememorableandwillbeoneyoudonotwanttomiss!
Lee Henson is currently one of just over 100 Certified Scrum Trainers (CST) worldwide. He is also a Project Management Professional (PMP) and a PMI-Agile Certified Practitioner and has worked as a GUI web developer, quality assurance analyst, automated test engineer, QA Manager, product manager, project manager, ScrumMaster, agile coach, consultant, & training professional. Lee is a graduate of the Disney Management Institute and is the author of the Definitive Agile Checklist. He publishes the Agile Mentor Newsletter.
Wednesday, 17 octoberjEff Havensjeff HavensSpeakern Trainern Author
Uncrapify Your life!Thisaward-winningkeynoteisastudyinexactlywhatnottodo.Promisingtogivehisaudiencespermissionratherthanadvice,Jeffwill‘encourage’yourteamtocriticizeothersandoutsourceblame
beforebringingitallhomewithaseriousdiscussionaboutpropercommunication,customerservice,andaccountabilitypractices.Tiredofbeingtoldwhattodo.Sickofattendingsessionsthattellyouhowtobecomeabettercommunicatororamoreeffectiveleader,andyoudefinitelydon’twanttohearanymoregarbageabouteffectivechangemanagement.Experiencesomethingdifferent.Youwon’tbetoldwhattodo.Instead,youwillbegivenpermissiontodoallofthethingsyou’vealwayswantedtodo–tobecometheworstpersonyoucanpossiblybe–tobesurethatyouareconvenientlyleftoffofcompanyemailsinvitingyoutosocialfunctions.Andifyou’renotcareful,youmightactuallylearnsomething.
Session Takeaways:
n Howtoavoidnegativeandunproductiveconversationsn Thepowerofsincere,straightforwardcommunicationn Howtoapproachchangeinordertoachieveseamlessintegration
A Phi Beta Kappa graduate of Vanderbilt University, Jeff Haven began his career as a high school English teacher before branching into the world of stand-up comedy, where he worked with some of the brightest lights in American comedy and honed the art of engaging audiences through laughter. But his impulse to teach never faded, and soon he began looking for an avenue to combine both of his passions into entertaining and meaningful presentations.
P a g e 4
keynotes9 : 0 0 a m – 1 0 : 1 5 a m
CONFERENCE FALL 2 012
P a g e 5
Thursday, 18 october(9:00am – 10:00am)
KarEn n. JohnsonKaren n. JohnsonFoundern Software Test Management, Inc.
The Discipline aspect of software TestingYourmissionistoregressiontestawebsitefortheumpteenthtime,preferablywithfresheyesandathoroughreview.Afterall,you’retheoneholdingupthissoftwarefrombeingusedby
payingcustomers.Thepressuremountsandyetprocrastinationtakeshold.
It’stime,timetorollupyoursleevesandfinishtheworkathandandyet,youjustdon’tfeellikeit.Howdoyoudisciplineyourselftogetthejobdone?Discipline.Focus.Howdoyoupullonthereservoirsofthesenecessaryskills?Howdoweinvokedisciplinetogetthejobdone?Tobeginwith,youhavetoadmityouhaveachallengetoovercomeandinthispresentation,therealityofneedingtobedisciplinedandfocusedtogetworkdone,mostespeciallygettingworkdoneunderpressure,willbediscussed.
Tacticswillbesharedforgettingthroughstacksofworkwhenyoudon’tfeelinspired.Wewilllookathowtobuildrigoranddisciplineintoyourpracticeinsoftwaretesting.Softwaretestingtakesacertainamountofdisciplineandrigor;ittakestheabilitytofocusandthinkwhilefrequentlyunderstressfulconditions.Thispresentationwillprovideanhonestlookat(aswellaspracticaltips)howtobuildrigoranddisciplineintoyourpracticeinsoftwaretesting.
Karen N. Johnson is an independent software test consultant. She is a frequent speaker at conferences. Karen is a contributing author to the book, Beautiful Testing released by O’Reilly publishers. She is the co-founder of the WREST workshop, more information on WREST can be found at: http://www.wrestworkshop.com/Home.html. She has published numerous articles and blogs about her experiences with software testing. You can visit her website at: http://www.karennjohnson.com.
Wednesday, 17 october(This keynote will be offered immediately following lunch from 2:00pm – 2:45pm)
Matt JohnstonMatt Johnston
P a g e 5
CONFERENCE FALL 2 012
CMOn uTest
Mobile Market Metrics: breaking Through the HypeServingconsumers’voraciousappetiteforsmartphones,tablets,e-readers,gamingconsoles,connectTVsandapps–advancementsinmobiletechnologyarehappeningatwarpspeed.
Manufacturers,carriersandappmakershavealltheirchipsonthetable,launchingdozensofuniquedevicesperyear,releasingnewandimprovedoperatingsystems,andaligningbehindamultitudeofbrowsersandOSstandards.It’sadizzyingtaskfortestandengineeringprofessionalstokeepupwithallthechanges,letalonefigureoutwhichonesneedtobesupportedintheirindustry,intheircompany,andintheirdepartment.Yet,despiteallthefragmentationintoday’smobileuniverse,techprofessionalshavetomakedifficultchoices.Daunting?Yes.Butthere’ssomethingbetterthantealeavesandacrystalballtotakesomeofthe“guess”outofourguesstimations:mobilemarkettrendsandstatistics.
We’lllookatawidevarietyofmobilemetricsthatcutthroughthehype,comparingthegrowing(andwaning)popularityofdifferentdevices,operatingsystemsandrelatedtechthatmayinfluenceattendees’testinganddevelopmentdecisions.Roundingoutthediscussion,we’llendwithforward-lookinginsightsintothemostpromising,emergingtechnologies.
Matt Johnston leads uTest’s marketing and community efforts as CMO, with more than a decade of marketing experience at companies ranging from early-stage startups to publicly traded enterprises. He continues to lead uTest’s efforts in shaping the brand, building awareness, generating leads and creating a world-class community of testers. Matt earned a B.A. in Marketing from Calvin College, as well as an MBA in Marketing & Technology from New York University’s Stern School of Business.
P a g e 6
regiSTer www.STPCon.com or call 877.257.9531
Monday, october 15, 2012 8:00am-4:00pm Registration&Information
8:00am-9:00am ContinentalBreakfast&Networking
9:00am-4:00pm Pre-Conference Workshops Pre-1:MobileTestAutomation (Brad Johnson, Fred Beringer) Pre-2:TestingMetrics:Process,Project,andProduct (Rex Black) Pre-3:NewWorldPerformance(Mark Tomlinson) Pre-4:Hands-on:RemoteTestingforCommonWebApplicationSecurityThreats(David Rhoades)
10:30am-11:00am MorningBeverageBreak
12:30pm-1:30pm Lunch
3:00pm-3:30pm AfternoonBeverageBreak
Tuesday, october 16, 20128:00am-8:00pm Registration&Information
8:00am-9:00am Breakfast
9:00am-10:15am General Session: TestingAgilityLeadstoBusinessFragility(Lee Henson)
10:30am-11:45am Session Block 1 101:PreparingtheQABudget,Effort&TestActivities–Part1(Paul Fratellone) 102:TestingwithChaos(James Sivak) 103:AtoZTestinginProduction:IndustryLeadingTechniquestoLeverageBigDataforQuality (Seth Elliott) 104:MobileTestAutomationforEnterprise&BusinessApplications(Sreekanth Singaraju) 105:TestLikeaNinja:Hands-OnQuickAttacks(Andy Tinkham)
11:45am-12:00pm MorningBeverageBreak
12:00pm-1:15pm Session Block 2 201:PreparingtheQABudget,Effort&TestActivities–Part2(Paul Fratellone) 202:SoftwareReliability,theDefinitiveMeasureofQuality (Lia Johnson) 203:CSI:Miami–SolvingApplicationPerformanceWhodunits(Kerry Field) 204:BuildingaSolidFoundationforAgileTesting (Robert Walsh) 205:ComplementVirtualTestLabswithServiceVirtualization (Wayne Ariola)
1:15pm-2:30pm Lunch&SpeedGeeking
2:30pm-3:45pm Session Block 3 301:LeadingCulturalChangeinaCommunityofTesters(Keith Klain) 302:SoftwareTestingHeuristics&Mnemonics(Karen Johnson) 303:InterpretingandReportingPerformanceTestResults–Part1(Dan Downing) 304:FindingtheSweetSpot–MobileDeviceTestingDiversity(Sherri Sobanski) 305:TheTroublewithTroubleshooting(Brian Gerhardt)
4:00pm-4:30pm ToolsandTrendsShowcase
4:30pm-4:45pm AfternoonBeverageBreak
4:45pm-6:00pm Session Block 4 401:Don’tIgnoretheManBehindtheCurtain(Bradley Baird) 402:OptimizingModularTestAutomation(David Dang) 403:InterpretingandReportingPerformanceTestResults–Part2(Dan Downing) 404:Agilevs.Fragile:ADisciplinedApproachoranExcuseforChaos (Brian Copeland) 405:MobileSoftwareTestingExperience (Todd Schultz)
6:00pm-8:00pm ExhibitorHours
6:00pm-8:00pm HappyHourWelcomeReception
O c t o b e r 1 5 – 1 8 , 2 0 1 2
schedule at a glance
CONFERENCE FALL 2012
P a g e 7
Wednesday, october 17, 20128:00am-6:00pm Registration&Information
8:00am-9:00am Breakfast&SponsorRoundtables
9:00am-10:15am General Session & Sponsor Prize Giveaway: UncrapifyYourLife(Jeff Havens)
10:30am-11:45am Session Block 5 501:BuildingASuccessfulTestCenterofExcellence–Part1(Mike Lyles) 502:HowtoPreventDefects(Dwight Lamppert) 503:TheTestingRenaissanceHasArrived–OnaniPadintheCloud(Brad Johnson) 504:Non-RegressionTestAutomation–Part1(Doug Hoffman) 505:Slow-MotionPerformanceAnalysis(Mark Tomlinson)
11:45am-12:00pm MorningBeverageBreak
12:00pm-1:15pm Session Block 6 601:BuildingASuccessfulTestCenterofExcellence–Part2(Mike Lyles) 602:AetnaCaseStudy–ModelOffice(Fariba Marvasti) 603:ApplicationPerformanceTestPlanningBestPractices(Scott Moore) 604:Non-RegressionTestAutomation–Part2(Doug Hoffman) 605:KeepingUp!(Robert Walsh)
1:15pm-2:45pm Lunch
2:00pm-2:45pm General Session:MobileMarketMetrics:BreakingThroughTheHype(Matt Johnston)
3:00pm-4:15pm Session Block 7 701:TechnicalDebt:ATreasuretoDiscoverandDestroy(Lee Henson) 702:DependenciesGoneWild:TestingCompositeApplications(Wayne Ariola) 703:Top3PerformanceLandMinesandHowtoAddressThem(Andreas Grabner) 704:BuildingAutomationFromtheBottomUp,NottheTopDown(Jamie Condit) 705:ThereCanOnlyBeOne:ATestingCompetition–Part1(Matt Heusser)
4:15pm-4:30pm AfternoonBeverageBreak
4:30pm-5:45pm Session Block 8 801:MaintainingQualityinaPeriodofExplosiveGrowth–ACaseStudy (Todd Schultz) 802:TestingintheWorldofKanban–TheEvolution(Carl Shaulis) 803:RefocusingTestingStrategyWithintheContextofProductMaturity (Anna Royzman) 804:MobileTesting:Tools,Techniques&TargetDevices(Uday Thongai) 805:ThereCanOnlyBeOne:ATestingCompetition–Part2(Matt Heusser)
Thursday, october 18, 20128:00am-1:00pm Registration&Information
8:00am-9:00am Breakfast&WrapUpRoundtables
9:00am-10:00am General Session: TheDisciplineAspectofSoftwareTesting(Karen N. Johnson)
10:15am-11:30am Session Block 9 901:7HabitsofHighlyEffectiveTesters (Rakesh Ranjan) 902:AdvancesinSoftwareTesting–APanelDiscussion (Matt Heusser) 903:PerformanceTestingMetricsandMeasures (Mark Tomlinson) 904:HowandWheretoInvestYourTestingAutomationBudget(Sreekanth Singaraju) 905:Memory,PowerandBandwidth–ohMy!MobileTestingBeyondtheGUI(JeanAnn Harrison)
11:30am-11:45am MorningBeverageBreak
11:45am-1:00pm Session Block 10 1001:RedefiningthePurposeofSoftwareTesting (Joseph Ours) 1002:EvaluatingandImprovingUsability(Philip Lew) 1003:RealWorldPerformanceTestinginProduction(Dan Bartow) 1004:ScalingGracefullyandTestingResponsively(Richard Kriheli) 1005:Quick,Easy&UsefulPerformanceTesting:NoToolsRequired(Scott Barber)
P a g e 8
a d v a n c e d e d u c a t i o n
conference tracksleadership Perspectives for Testers
Understandingthebusinesssideoftestingisasimportantasamplifyingourapproachesandtechniques.Inthistrackyouwilllearnhowtobuildatestingbudget,effectivelymanagetestteams,communicatewithstakeholders,andadvocatefortesting.
101: PreparingtheQABudget,Effort&TestActivities–Part1201: PreparingtheQABudget,Effort&TestActivities–Part2401: Don’tIgnoretheManBehindtheCurtain701: TechnicalDebt:ATreasuretoDiscoverandDestroy801: MaintainingQualityinaPeriodofExplosiveGrowth–ACaseStudy901: 7HabitsofHighlyEffectiveTesters1001:RedefiningthePurposeofSoftwareTesting
strategic business alignment
Thebestwaytoensurethatthegoalsofyourprojectandtheorganizationaremetattheendofproduction,istomakesuretheyarealignedfromthebeginning.Thiswillrequireanabilitytoeffectivelyleaddiverseteamsandgainbuy-inandagreementthroughoutthelifeoftheproject.Thistrackwilloffersessionsbasedonreallifeexperiences
andcasestudieswheretruebusinessalignmentwasachievedresultinginasuccessfuloutcome.
202: SoftwareReliability,TheDefinitiveMeasureofQuality301: LeadingCulturalChangeinaCommunityofTesters501: BuildingASuccessfulTestCenterofExcellence–Part1601: BuildingaSuccessfulTestCenterofExcellence–Part2
Test strategy, Process and Design
Beforeyoubegintestingonaproject,yourteamshouldhaveaformalorinformalteststrategy.Therearekeyelementsyouneedtoconsiderwhenformulatingyourteststrategy.Ifnot,youmaybewastingvaluabletime,moneyandresources.Inthistrackyouwilllearnthestrategicandpracticalapproachestosoftwaretestingand
testcasedesign,basedontheunderlyingsoftwaredevelopmentmethodology.
102: TestingwithChaos302: SoftwareTestingHeuristics&Mnemonics502: HowtoPreventDefects602: AetnaCaseStudy–ModelOffice702: DependenciesGoneWild:TestingCompositeApplications802: TestingintheWorldofKanban–TheEvolution902: AdvancesinSoftwareTesting–APanelDiscussion1002:EvaluatingandImprovingUsability
Performance Testing
PerformanceTestingisaboutcollectingdataonhowapplicationsperformtoassistthedevelopmentteamandthestakeholdersmaketechnicalandbusinessdecisionsrelatedtoperformancerisks.Inthistrackyouwilllearnpracticalskills,tools,andtechniquesforplanningandexecutingeffectiveperformancetests.Thistrackwillinclude
topicssuchas:performancetestingvirtualizedsystems,performanceanti-patterns,howtoquantifyperformancetestingrisk,allillustratedwithpractitioners’actualexperiencesdoingperformancetesting.
103: AtoZTestinginProduction:IndustryLeadingTechniquestoLeverageBigDataforQuality203: CSI:Miami–SolvingApplicationPerformanceWhodunits303: InterpretingandReportingPerformanceTestResults–Part1403: InterpretingandReportingPerformanceTestResults–Part2603: ApplicationPerformanceTestPlanningBestPractices703: Top3PerformanceLandMinesandHowtoAddressThem903: PerformanceTestingMetricsandMeasures1003:RealWorldPerformanceTestinginProduction
CONFERENCE FALL 2012
P a g e 9
Test automation
Whichtestscanbeautomated?Whattoolsandmethodologycanbeusedforautomatingfunctionalityverification?Chancesarethesearesomeofthequestionsyouarecurrentlyfacingfromyourprojectmanager.Inthistrackyouwilllearnhowtoimplementanautomationframeworkandhowtoorganizetestscriptsformaintenance
andreusability,aswellastakeawaytipsonhowtomakeyourautomationframeworkmoreefficient.
205: ComplementVirtualTestLabswithServiceVirtualization402: OptimizingModularTestAutomation504: Non-RegressionTestAutomation–Part1604: Non-RegressionTestAutomation–Part2704: BuildingAutomationFromtheBottomUp,NottheTopDown904: HowandWheretoInvestYourTestingAutomationBudget
agile Testing
TheManifestoforAgileSoftwareDevelopmentwassignedoveradecadeago.TheAgileframework’sfocusonagilityisanythingbutundisciplined.ThistrackwillhelpparticipantsunderstandhowtheycanfittraditionaltestpracticesintoanAgileenvironmentaswellasexplorereal-worldexamplesoftestingprojectsandteams
invaryingdegreesofAgileadoption.
204: BuildingaSolidFoundationForAgileTesting404: AgilevsFragile:ADisciplinedApproachoranExcuseforChaos605: KeepingUp!803: RefocusingTestingStrategyWithintheContextofProductMaturity
Mobile application Testing
Therapidexpansionofmobiledevicesoftwareisalteringthewayweexchangeinformationanddobusiness.Thesedayssmartphoneshavebeenintegratedintoagrowingnumberofbusinessprocesses.Developingandtestingsoftwareformobiledevicespresentsitsownsetofchallenges.Inthistrackparticipantswilllearnmobile
testingtechniquesfromreal-worldexperiencesaspresentedbyaselectionofindustryexperts.
104: MobileTestAutomationforEnterprise&BusinessApplications304: FindingtheSweetSpot–MobileDeviceTestingDiversity503: TheTestingRenaissanceHasArrived(onaniPadintheCloud)804: MobileTesting:Tools,Techniques&TargetDevices1004:ScalingGracefullyandTestingResponsively
Hands-on Practicals
Thistrackisuniquelydesignedtocombinethebestsoftwaretestingtheorieswithreal-worldtechniques.Participantswillactuallylearnbydoinginthishands-onformatsimulatingrealistictestenvironments.Afterall,applyingtechniqueslearnedinaclassroomtoyourindividualneedsandrequirementscanbe
challenging.Seventechnicalsessionscoveringawiderangeoftestingtopicswillbepresented.Participantsmustbringalaptopcomputerandpowercord.
105: TestLikeaNinja:Hands-OnQuickAttacks305: TheTroublewithTroubleshooting405: MobileSoftwareTestingExperience505: Slow-MotionPerformanceAnalysis705: ThereCanBeOnlyOne:ATestingCompetition(Part1)805: ThereCanBeOnlyOne:ATestingCompettition(Part2)905: Memory,PowerandBandwidth–OhMy!MobileTestingBeyondtheGUI
P a g e 1 0
regiSTer www.STPCon.com or call 877.257.9531
Monday15 october9 : 0 0 a m – 4 : 0 0 p m
Pre-1 Fred Beringer, VP, Product Management,SOASTA
Brad Johnson, VP Product and Channel Marketing,SOASTA Mobile Test automation Inthisfull-dayworkshop,youwillleavewiththeskillsandtoolstobeginimplementingyourmobilefunctionaltestautomationstrategy.SOASTA’sFredBeringerandBradJohnsonwillwalkyouthroughthebasics:
nCreatingyourplanof“WhattoTest”nEnablingamobileapptobetestablenCapturingyourfirsttestcasesnSettingvalidationsanderrorconditionsnRunningandexecutingmobilefunctionaltestcasesnFunandGames:MobileTestAutomationHackathon!
AttendeeswillbeprovidedfreeaccessandcredentialstotheCloudTestplatformforthissession.Testswillbebuiltandexecutedusingattendees’ownIOSorAndroidmobiledevices,socomewithyoursmartphoneschargedandreadytobecomepartoftheSTPConFallMobileDeviceTestCloud!
Brad Johnson joined the front lines of the Testing Renaissance in 2009 when he signed on with SOASTA to deliver testing on the CloudTest platform to a skeptical and established software testing market.
Fred Beringer has 15 years ofsoftware development and testing experience managing large organizations where he was responsible for developing software and applications for customers.
Pre-2 Rex Black, President,RBCS
Testing Metrics: Process, Project, and Product Someofourfavoriteengagementsinvolvehelpingclientsimplementmetricsprogramsfortesting.Factsandmeasuresarethefoundationoftrueunderstanding,butmisuseofmetricsisthecauseofmuchconfusion.Howcanweusemetricstomanagetesting?Whatmetricscanweusetomeasurethetestprocess?Whatmetricscanweusetomeasureourprogressintestingaproject?Whatdometricstellusaboutthequalityoftheproduct?Inthisworkhop,Rexwillsharesomethingshe’slearnedaboutmetricsthatyoucanputtoworkrightaway,andyou’llworkonsomepracticalexercisestodevelopmetricsforyourtesting.
Workshop Outline
1.Introduction
2.TheHowandWhyofMetricsnPresentationnExercise
3.ProcessMetricsnPresentationnCasestudynExercise
4.ProjectMetricsnPresentationnCasestudynExercise
5.ProductMetricsnPresentationnCasestudynExercise
6.Conclusion
Learning Objectives
nUnderstandtherelationshipbetweenobjectivesandmetrics
nForagivenobjective,createoneormoremetricsandsetgoalsforthosemetrics
nUnderstandtheuseofmetricsforprocess,project,andproductmeasurement
nCreatemetricstomeasureeffectiveness,efficiency,andstakeholdersatisfactionforatestprocess
nCreatemetricstomeasureeffectiveness,efficiency,andstakeholdersatisfactionforatestproject
nCreatemetricstomeasureeffectiveness,efficiency,andstakeholdersatisfactionforaproductbeingtested
Rex Black is a prolific author, practicing in the field of software testing today. His first book, Managing the Testing Process, has sold over 50,000 copies.
workshopsP r e - C o n f e r e n c e
P a g e 1 1
CONFERENCE FALL 2 012
Pre-2 Testing Metrics: Process, Project, and Product Someofourfavoriteengagementsinvolvehelpingclientsimplementmetricsprogramsfortesting.Factsandmeasuresarethefoundationoftrueunderstanding,butmisuseofmetricsisthecauseofmuchconfusion.Howcanweusemetricstomanagetesting?Whatmetricscanweusetomeasurethetestprocess?Whatmetricscanweusetomeasureourprogressintestingaproject?Whatdometricstellusaboutthequalityoftheproduct?Inthisworkhop,Rexwillsharesomethingshe’slearnedaboutmetricsthatyoucanputtoworkrightaway,andyou’llworkonsomepracticalexercisestodevelopmetricsforyourtesting.
Workshop Outline
4.ProjectMetricsnPresentationnCasestudynExercise
5.ProductMetricsnPresentationnCasestudynExercise
6.Conclusion
Learning Objectives
nUnderstandtherelationshipbetweenobjectivesandmetrics
nForagivenobjective,createoneormoremetricsandsetgoalsforthosemetrics
nUnderstandtheuseofmetricsforprocess,project,andproductmeasurement
nCreatemetricstomeasureeffectiveness,efficiency,andstakeholdersatisfactionforatestprocess
nCreatemetricstomeasureeffectiveness,efficiency,andstakeholdersatisfactionforatestproject
nCreatemetricstomeasureeffectiveness,efficiency,andstakeholdersatisfactionforaproductbeingtested
Pre-3 Mark Tomlinson, President,West Evergreen Consulting, LLC
new World PerformanceIt’salwaysasignificantchallengeperformancetestersandengineerstokeepupwiththebreadthofhotnewtechnologiesandinnovationscomingataferociouspaceinourindustry.Notonlyhasthetechnologyandsystemlandscapechangedinthelastfewyears,butthemethodsandtechniquesforperformancetestingarealsoupdatingrapidly.Ourresponsibilityasperformancetestersandengineersistolearnandmasterthesenewapproachestoperformancetesting,optimizationandmanagementandserveourorganizationswiththemostvaluableknowledgeandskillpossible.InmytravelsI’veoftenheardquestionsfromfellowperformancetesters:Outofallthenewtechnologiesoutthere,whatshouldIbelearning?Whatnewtoolsforperformanceareoutthere?HowdoIbetterfitinwithagiledevelopmentandoperations?HowdoIupdatedandrefreshmyskillstokeepcurrentandvaluabletomycompany?SpendadaywithMarkandyouwillfindanswerstothesequestions.
Mark’sworkshopwillhelpyoutobebetterpreparedtochartyourowncourseforthefutureofperformanceandyourcareer.Markwillsharewithyouthemostrecentdevelopmentsinperformancetestingtools,approachesandtechniques;howtobestconsideryourcurrentandfuturestrategyaroundperformance.
Workshop Outline
nIntroductiontotheNewWorldofPerformancenNewApproachesandMethodsnNewPerformanceRolesnNewSkillsandTechniquesnNewPerformanceToolsnConclusion
Mark Tomlinsonis a software tester and test engineer. His first test project in 1992 sought to prevent trains from running into each other – and Mark has metaphorically been preventing “train wrecks” for his customers for the past 20 years.
Pre-4 David Rhoades, Senior Consultant,Maven Security Consulting, Inc.
Hands-on: Remote Testing for Common Web application security ThreatsTheproliferationofweb-basedapplicationshasincreasedtheenterprise’sexposuretoavarietyofthreats.Thereareoverarchingstepsthatcanandshouldbetakenatvariousstepsintheapplication’slifecycletopreventormitigatethesethreats,suchasimplementingsecuredesignandcodingpractices,performingsourcecodeaudits,andmaintainingproperaudittrailstodetectunauthorizeduse.
Thisworkshop,throughhands-onlabsanddemonstrations,willintroducethestudenttothetoolsandtechniquesneededtoremotelydetectandvalidatethepresenceofcommoninsecurityforweb-basedapplications.Testingwillbeconductedfromtheperspectiveoftheenduser(asopposedtoasourcecodeaudit).Securitytestinghelpstofulfillindustrybestpracticesandvalidateimplementation.Securitytestingisespeciallyusefulsinceitcanbedoneatvariousphaseswithintheapplication’slifecycle(e.g.duringdevelopment),orwhensourcecodeisnotavailableforreview.
Thisworkshopwillfocusonthemostpopularandcriticalthreatsfacingwebapplications,suchascross-sitescripting(XSS)andSQLinjection,basedontheindustrystandardOWASP“TopTen.”Thefoundationlearnedinthisclasswillenablethestudenttogobeyondthetoptenviaself-directedlearningusingotherindustryresources,suchastheOWASPTestingGuide.
David Rhoadesis a senior consultant with Maven Security Consulting Inc. which provides information security assessments and training services to a global clientele. His expertise includes web application security, network security architectures, and vulnerability assessments.
P a g e 1 2
session block 1
regiSTer www.STPCon.com or call 877.257.9531
Andy Tinkhamisanexpertconsultant,focusingonallaspectsofqualityandsoftwaretesting(butmostofall,testautomation).Currently,heconsultsforaMagenic,aleadingproviderof.NETandtestingservices.
James Sivakhasbeeninthecomputertechnologyfieldforover35years,beginningwiththeSpaceShuttleandovertheyearshasencompassedwarehousesystems,cyclotrons,operatingsystems,andnowvirtualdesktops.
Sreekanth Singarajuhasmorethan12yearsofseniortechnologyleadershipexperienceandleadsAlliance’sQA&Testingorganizationindevelopingcuttingedgesolutions.
Paul Fratellone,a25yearcareerveteraninqualityandtesting,hasbeenaDirectorofQAandiswell-seasonedinpreparingdepartmentwidebudgets.
Seth EliotisSeniorKnowledgeEngineerforMicrosoftTestExcellencefocusingondrivingbestpracticesforservicesandclouddevelopmentandtestingacrossthecompany.
1 0 : 3 0 a m – 1 1 : 4 5 a m
Tuesday16 october
101 Paul Fratellone, ProgramDirectorQuality&TestConsulting,MindTree Consulting
Preparing the Qa budget, effort & Test activities – Part 1Thissessionwillbeanintroductiontopreparingatestteambudgetnotonlyfromamanpowerperspectivebutalsofromtheperspectiveoftestingeffortestimationandforecasting.Thespeakerwillbepullingfromreal-lifescenariosthathavecoveredamyriadofsituationsofcreatingorinheritingabudgetfortestingservices.Usingtheseexperiences,thespeakerwillhighlightgoodpracticesandsuccessesinadditiontopitfallstoavoid.Howtodevelopabudgetforbothprojectbased(largeenterprisewideprojectsthroughmid-sized)andportfolio/programtestingservicessupportacrosstheorganizationwillbepresented.Inpartone,thefinancial/accountingaspectsofabudget(high-level)willbediscussedandhowfull-timeequivalents(FTEs)aretrulyaccounted;thedetailsofa“fullyloaded”resourcewillbeexplained;andthedifferencebetweencapitalandoperationalexpendituresandpotentialtaxeffectswillbepresented.Wewillalsodeveloparesourceestimationmodelthatrepresentsreal-worldsituationsandintroduceconfidenceandlevels/iterationsofabudget/resourceplan.
Session Takeaways:
nHowtoprepareaQA/TestingDepartmentBudgetnHowtocreateanestimationmodel
102 James Sivak,DirectorofQA,Unidesk
Testing with ChaosTesterscanbecomesofocusedonthetestingathandandhowtomakethatasefficientaspossible(generallydrivenbymanagementdirectives)thatenvironmentsandtestsunconsciouslygetmissed.Broadeningthevisiontoincludeideasfromchaosandcomplexitytheoriescanhelptodiscoverwhycertainclassesofbugsonlygetfoundbythecustomer.Thispresentationwillintroducetheseideasandhowtheycanbeappliedtotestsandtestenvironments.Incorporatingrandomnessintotests
P a g e 1 3
CONFERENCE FALL 2 012
andthetestenvironmentswillbediscussed.Inaddition,thoughtsonwhattoanalyzeincustomerenvironments,lookingthroughthelensofcomplexity,willbepresented.Comparisonsofenvironmentswithandwithoutfacetsofchaoswillbedetailedtogivetheaudienceconcreteexamples.Otherexamplesofintroducingrandomnessintotestswillbeprovided.Youwillwalkawaywithideasonwhyandhowtoaddchaostoyourtesting,catchinganotherclassofbugsbeforeyourcustomersdo.
Session Takeaways:
nIdeasonwhatmakestestingandtestenvironmentscomplex
nBenefitsofaddingchaostothetestingnVisionperspectivesinviewingcurrenttest
environmentsandhowtodisruptthetestingparadigm
103 Seth Eliot, SeniorKnowledgeEngineerinTest,Microsoft
a to Z Testing in Production: Industry leading Techniques to leverage big Data for QualityTestinginproduction(TiP)isasetofsoftwaremethodologiesthatderivequalityassessmentsnotfromtestresultsruninalabbutfromwhereyourservicesactuallyrun–inproduction.Thebigdatapipefromrealusersandproductionenvironmentscanbeusedinawaythatbothleveragesthediversityofproductionwhilemitigatingriskstoendusers.Byleveragingthisdiversityofproductionweareabletoexercisecodepathsandusecasesthatwewereunabletoachieveinourtestlabordidnotanticipateinourtestplanning.
ThissessionintroducestestmanagersandarchitectstoTiPandgivesthesedecisionmakersthetoolstodevelopaTiPstrategyfortheirservice.MethodologieslikeControlledTestFlights,SyntheticTestinProduction,Load/CapacityTestinProduction,DataMining,DestructiveTestingandmoreareillustratedwithexamplesfromMicrosoft,Netflix,Amazon,andGoogle.ParticipantswillseehowthesestrategiesboostROIbymovingfocustolivesiteoperationsastheirsignalforquality.
104 Sreekanth Singaraju, VPofTestingServices,Alliance Global Services
Mobile Test automation for enterprise & business applications
WiththecommercializationofIT,mobileappsareincreasinglybecomingastandardformatofdeliveringapplicationsinenterprisesalongsideWebapplications.Testingorganizationsintheseenterprisesarefacingtheprospectofaddingnewtestinginterfacesanddevicestothelonglistofexistingneeds.Thissessionwillshowcaseanapproachandframeworktodevelopingasuccessfulmobiletestautomationstrategyusingreallifeexamples.UsingaframeworkdevelopedbyintegratingRobotiumandSelenium,thissessionwillwalkparticipantsthroughanapproachtodevelopinganintegratedtestautomationframeworkthatcantestapplicationswithwebandmobileinterfaces.
Thissessionhighlightsthefollowingkeyaspectsofdevelopinganintegratedautomationframework:
nMobiletestautomationstrategynTestdatamanagementnReportingnTestLabconfiguration,includingmulti-device
managementnChallenges,lessonslearnedandbestpractices
todevelopasuccessfulframework
105 Andy Tinkham, PrincipalConsultant,Magenic
Test like a ninja: Hands-on Quick attacksInthissession,we’lltalkaboutquickattacks–smallteststhatcanbedonerapidlytofindcertainclassesofbugs.Thesetestsareeasytorunandrequirelittletonoupfrontplanning,whichmakesthemidealforquicklygettingfeedbackonyourapplicationundertest.Inthissession,we’llbrieflytalkaboutwhatquicktestsareandthendiveintospecificattacks,tryingthemonsampleapplications(ormaybeevensomerealapplications!).Thisisahands-onsession,sobringalaptoporpairwithsomeonewhohasone,andtrythesetechniquesliveinthesession!
Session Takeaways:
nAknowledgeofsomequickteststhatyoucanuseimmediatelyinyourowntesting
nSpecifictoolsandtechniquestoexecutethesequicktests
nExperienceexecutingthequicktestsnReferencesforfurtherexplorationofquick
testsandhowtheycanbeapplied
session block
P a g e 1 4
regiSTer www.STPCon.com or call 877.257.9531
Tuesday16 october
201 Paul Fratellone,ProgramDirectorQuality&TestConsulting,MindTree Consulting
Preparing the Qa budget, effort & Test activities – Part 2InPart2ofthissession,thespeakerwillshowcaseexcel-basedworksheetstodemonstratetesteffort,testcyclesandtestcasemodelingtechniquesandhowtointroduceconfidenceinescalatinglevels/iterationsofabudgetasinformationincreasesinstabilityandaccuracythroughoutaproject/testingsupportactivity.Coveredwillalsobetheeffectsofthedeliverylifecyclemethodsandbudgeting.Howwilltestingbudgetsdifferbetweenwaterfallandagiledeliverymethods/lifecycles?
Session Takeaways:
nHowtobudgetfortestcyclesnDealingwithAgilevs.Waterfallprojectbudgets
202 Lia Johnson,Manager,Drilling&EvaluationSoftwareTesting,Baker Hughes Inc.
software Reliability, The Definitive Measure of QualityThroughouttheprojectlife-cycle,measuresofquality,testsuccess,andtestcompletionareindicativeofprogress.Theculminationofthesemetricsisoftendifficultforsomestakeholderstotranslateforacceptance.Softwarereliabilitydependenciesbeginwithmodeldriventestsderivedfromuse-cases/userstoriesiniterativeoragiledevelopmentmethodologies.Aligningthetestprocesswithaproject’sdevelopmentmethodologyandinmanycasesPDMisintegraltoachievingacceptablelevelsofsoftwarereliability.Relevantdependenciesthatimpactsoftwarereliabilitybeginwithtestfirst,testcontinuously.Somedependenciesarewithinthescopeofresponsibilityforsoftwaretestprofessionals.Othersrequirecollaborationwiththeentireprojectteam.Developingapplicationsaccordingtostandardcodingpracticesisalsoessentialtoattainsoftwarequality.Unittestsdevelopedandexecutedsuccessfullyimpactsoftwarequality.Thesedependenciesandmorewillbediscussedasweexplorethedefinitivemeasureofquality,softwarereliability.
Robert Walsh, aproponentofAgilesoftwaredevelopmentprocessesandtechniques,believesstronglyindeliveringqualitysolutionsthatsolverealcustomerproblemsandprovidetangiblebusinessvalue.
Lia JohnsonbeganhercareerattheCIAandNASAasasoftwaredeveloperupongraduationfromLamarUniversitywithaBBAinComputerScienceandisnowworkingforBakerHughesIncorporatedasaSoftwareTestingManager.
Paul Fratellone,a25yearcareerveteraninqualityandtesting,hasbeenaDirectorofQAandiswell-seasonedinpreparingdepartmentwidebudgets.
Kerry Fieldhasover35yearsofexperienceinIT,includingapplicationsdevelopment,productandservicesupport,systemsandnetworkmanagement,functionalQA,capacityplanning,andapplicationperformance.
Wayne AriolaisVicePresidentofStrategyandCorporateDevelopmentatParasoft,aleadingproviderofintegratedsoftwaredevelopmentmanagement,qualitylifecyclemanagement,anddev/testenvironmentmanagementsolutions.
21 2 : 0 0 p m – 1 : 1 5 p m
CONFERENCE FALL 2 012
P a g e 1 5
Session Takeaways:
nTheDefinitiveMeasureofQualitynTheImportanceofProcessAlignmentto
DevelopmentMethodologiesnDependenciesofSoftwareReliability
203 Kerry Field,APMSpecialist,CSSManagementTeam,US Bank
CsI: Miami – solving application Performance WhodunitsApplicationperformanceproblemscontinuetohappendespitealltheresourcescompaniesemploytopreventthem.Whentheproblemisdifficulttosolve,theorganizationwilloftenbringinoutsideexpertise.WeseeasimilarthemeplayedoutonTVdetectiveshows.Whenthelocalauthoritiesarebaffled,thelikesofaJimRockford,Lt.Columbo,orAdrianMonkarebroughtin.Thesefictionaldetectivesroutinelysolveddifficultcasesbyapplyingtheiruniquepowersofobservation,intuition,anddeductivereasoning.Thewritersalsogaveeachcharacterauniquebackgroundoroddpersonalitytraitthatenhancedtheirentertainmentvalue.Solvingrealworldperformanceproblemsrequiresmuchmorethanacombinationofindividualskillsandanentertainingpersonality.Thissessionwillpresentexamplesofreallifeapplicationperformanceissuestakenfromtheauthor’scasefilestoillustratehowsuccessfulresolutiondependsoneffectiveteamwork,soundtroubleshootingprocess,andappropriateforensictools.
204 Robert Walsh,SeniorConsultant,Excalibur Solutions, Inc.
building a solid foundation for agile TestingSoftwaretestinginAgiledevelopmentenvironmentshasbecomeapopulartopicrecently.SomebelievethatconventionaltestingisunnecessaryinAgileenvironments.Further,somefeelthatalltestinginAgileshouldbeautomated,diminishingboththeroleandthevalueoftheprofessionaltester.WhileautomatedtestingisessentialinAgilemethodologies,manualtestinghasasignificantparttoplay,too.
SuccessfulAgiletestingdependsonastrategybuiltonfourpillars:automatedunittesting,automatedacceptancetesting,automatedregressiontesting,andmanualexploratorytesting.Thefourareinterdependent,andeachprovidesbenefitsthatarenecessaryforthe
otherstosucceed.EachpillaristheresponsibilityofadifferentgroupwithintheAgiledevelopmentteam,andwheneveryonedoeshispart,theresultisasolutionwherethewholeisgreaterthanthesumoftheparts.
Session Takeaways:
nGainanunderstandingofthechallengesfacedwhentestinginAgileenvironments
nLearnhowthefourpillarsprovideasolidfoundationonwhichasuccessfultestingorganizationcanbebuilt
nLearnwhythepillarsareinterdependentandunderstandwhytheabsenceofoneleavesagapinthetestingeffort
205 Wayne Ariola, VP of Strategy,Parasoft
Complement Virtual Test labs with service VirtualizationThissessionexplainswhyservicevirtualizationistheperfectcomplementtovirtualtestlabs–especiallywhenyouneedtotestagainstdependentapplicationsthataredifficultorcostlytoaccessand/ordifficulttoconfigureforyourtestingneeds.
Virtualtestlabsareidealfor“staging”dependentapplicationsthataresomewhateasytoaccessandhavelowtomediumcomplexity.However,ifthedependentapplicationisverycomplex,difficulttoaccess,orexpensivetoaccess,servicevirtualizationmightbeabetterfitforyourneeds.Servicevirtualizationfillsthegaparoundthevirtualtestlabbygivingyourteamavirtualendpointinordertocompleteyourtestenvironment.Thisway,thedevelopersandtesterscanaccessthenecessaryfunctionalitywhenevertheywant,asfrequentlyastheywant,withoutincurringanyaccessfees.Foranotherexample,assumeyouhaveamainframethat’seasilyaccessible,butdifficulttoconfigurefortesting,servicevirtualizationfillsthegapbyprovidingflexibleaccesstothecomponentsofthemainframethatyouneedtoaccessinordertoexercisetheapplicationundertest.Itenablestheteamtotestvs.abroadarrayofconditions–withminimalsetup.
Session Takeaways:
nRemoveroadblocksforperformancetesting,functionaltesting&Agile/paralleldevelopment
nClosethegapthatexistswithincompleteorcapacity-constrainedstagedtestenvironments
nStreamlinetestenvironmentprovisioningtimeandcostsbeyondtraditionalvirtualization
P a g e 1 6
session block
regiSTer www.STPCon.com or call 877.257.9531
Tuesday16 october
301 Keith Klain, Director,HeadofGlobalTestCenter,Barclays
leading Cultural Change in a Community of TestersWhenKeithKlaintookovertheBarclaysGlobalTestCenter,hefoundanorganizationfocusedentirelyonmanagingprojects,managingprocesses,andmanagingstakeholders–thelastmostunsuccessfully.Althoughtheteamwasextremelyproficientintestmanagement,theirmisalignedprioritieshadtheeffectofcontinuallyhittingthebullseyeonthewrongtarget.Keithimmediatelyimplementedchangestoputasysteminplacetofostertestingtalentanddriveoutfear–abandoningworthlessmetricsandmaturityprograms,overhaulingthetrainingregime,andinvestinginaculturethatrewardsteamworkandinnovation.Thechallengesofthesemonumentalchangesrequiredanewkindofleadership–somethingquitedifferentfromtraditionalmanagement.
FindouthowKeithisleadingtheBarclaysGlobalTestCenterandhearhispracticalexperiencesdefiningobjectivesandrelatingthemtopeople’spersonalgoals.LearnabouttheBarclaysCapitalGlobalTestCenter’s“ManagementGuidingPrinciples”andhowyoucanadapttheseprinciplestoleadyouandyourteamtoanewandbetterplace.
302 Karen N. Johnson,Founder,Software Test Management, Inc.
software Testing Heuristics & MnemonicsAreyoucuriousaboutheuristicsandhowtousethem?Inthissession,KarenJohnsonexplainswhataheuristicis,whatamnemonicis,andhowheuristicsandmnemonicsaresometimesusedtogether.AnumberofbothheuristicsandmnemonicshavebeencreatedinthesoftwaretestingcommunityandKarenreviewsseveralofeachandgivesexamplesofhowtouseandapplyheuristicsandmnemonics.Inthissession,Karenoutlineshowtocreateyourownmnemonicsandheuristics.Shealsoexploreswaystousebothasawaytoguideexploratorytestingefforts.
Sherri SobanskiiscurrentlytheSeniorStrategicArchitectAdvisorfocusingontechnicalteststrategyandinnovationsupportingAetna’stestingteam.SherriisalsotheactingheadofAetna’sMobileTestingCapabilityCenter.
Keith KlainistheheadoftheBarclaysGlobalTestCenter,whichprovidesfunctionalandnon-functionalsoftwaretestingservicestotheinvestmentbankingandwealthmanagementbusinesses.
Karen N. Johnsonisanindependentsoftwaretestconsultantandacontributingauthortothebook,BeautifulTestingandistheco-founderoftheWRESTworkshop.
ASoftwareTesterforthepast15years,Brian GerhardtstartedoffinproductionsupportwherehistroubleshootingskillsandrelentlesssearchforanswersleadtoacareerinQualityAssurance.HeiscurrentlywithLiquidnet.
Dan Downingteachesloadtestingandoverthepast13yearshasledhundredsofperformanceprojectsonapplicationsrangingfromeCommercetoERPandcompaniesrangingfromstartupstoglobalenterprises.
2 : 3 0 p m – 3 : 4 5 p m
3
P a g e 1 7
CONFERENCE FALL 2 012
303 Dan Downing, PrincipalConsultant,Mentora Group
Interpreting Performance Test Results – Part 1You’veworkedhardtodefine,developandexecuteaperformancetestonanewapplicationtodetermineitsbehaviorunderload.Yourinitialtestresultshavefilledacoupleof52gallondrumswithnumbers.Whatnext?Crankoutastandardreportfromyourtestingtool,senditout,andcallyourselfdone?NOT.Resultsinterpretationiswhereaperformancetesterearnstherealstripes.
Inthefirsthalfofthisdoublesessionwe’llstartbylookingatsomeresultsfromactualprojectsandtogetherpuzzleouttheessentialmessageineach.ThiswillbeahighlyinteractivesessionwhereIwilldisplayagraph,providealittlecontext,andask“whatdoyouseehere?”Wewillformhypotheses,drawtentativeconclusions,determinewhatfurtherinformationweneedtoconfirmthem,andidentifykeytargetgraphsthatgiveusthebestinsightonsystemperformanceandbottlenecks.Feelfreetobringyourownsampleresults(on a thumb drive soI can load and display)thatwecanengageparticipantsininterpreting!
304 Sherri Sobanski, SeniorStrategicArchitectAdvisor,Aetna
finding the sweet spot – Mobile Device Testing DiversityHowcanyoupossiblydoitall?!Infinitehardware/softwarecombinations,BYOD,crowdsourcing,virtualcapabilities,datasecurity...thelistgoesonandon.Companiesarestrugglingwithinsecure,complicatedandexpensiveanswerstothemobiletestingchallenges.TheAetnatechnicalteamshavecreatedaninnovativemobiletestingsetofsolutionsthatnotonlyprotectdatabutallowformanydifferentapproachestomobiletestingacrossthelifecycle.WhetheryouwanttotestfromtheCorporateLab,fromyourownbackyardorhalfwayaroundtheworld,wehaveasolution…youchoose.
Session Takeaways:
nHowtotacklethecomplexnatureofmobiletestingnTechniquestoaddressBYOD,OffshoreVendors,
CrowdsourcingnSoftwarecapabilitiesforvirtualtestingofmobiledevicesnPrivateandpublictestingclouds
305 Brian Gerhardt, OperationsandQualityLead, Liquidnet
The Trouble with TroubleshootingOneofthemostvaluableskillsetsasoftwaretestercanpossessistheabilitytoquicklytrackdowntherootcauseofabug.Atestermaydescribewhatthebugappearstobedoing,butfartoooftenitisnotenoughinformationfordevelopers,causingarepetitivecode/build/test/re-code/re-build/re-testcycletoensue.Inthisinteractivesession,youwillrotatebetweenlearninginvestigativetechniquesandapplyingthemtoactualexamples.Youwillpracticereproducingthebug,isolatingit,andreportingitinaconcise,clearmanner.
Thissessionwillpresentseveralinvestigativemethodsandshowhowtheycanbeusedasameansofinformationgatheringindeterminingtherootcauseofbugs.Commonteststhataredesignedtoeliminatefalseleadsaswellasteststhatcanbeusedtofocusinonthesuspectcodewillbeshownanddiscussedininteractiveexamples.
Session Takeaways:
nBuildaframeworkaroundtheirsoftwaretoeasefindingrootcausesofsoftwareissues
nQuicklyidentifywherethemostlikelycauseoftheerrorsare
nUseanew,empiricalinvestigativemethodforsoftwaretesting
nDelivermoreconcise,relevantinformationtodevelopersandprojectmanagerswhendescribinganddetailingissuesinthesoftware,becomingmorevaluableinmakingfix/shipdecisions
session block
P a g e 1 8
regiSTer www.STPCon.com or call 877.257.9531
Tuesday16 october
401 Bradley Baird,SeniorManagerProductQuality,Harman International
Don’t Ignore the Man behind the CurtainJustasintheWizardofOzwhereallthegreatpyrotechnicsgoingoninpublicwerecontrolledbythewizardhiddenbehindsthecurtain,soitisinQAwhereallthegreatqualitythatthecustomersseeiscontrolledbytheQAprofessional.Ifyouignorethe“Wizard”youdosoattheriskofcompromisingQuality.ThissessionwillcovertheperilsofignoringtheQAprofessionalbehindthecurtain.WespendmonthsorevenyearstrainingaQAengineeronlytoseethemwalkoutthedoorbecauseabetteropportunitycamealong.Youdon’tjustloseapersonyouloseknowledgethatissometimeshardtoreplace.
Inthissessionwewillexploreideasonhowtodevelopmanagementtraitsandskillsthatweperformonadailybasistomakesureourwizardskeeppullingthoseleversandtootingthosehornsforusinsteadofourcompetitor.
Session Takeaways:
nIdeasonmanagingorleadingaQAteamnHowtotreatahumanasapersonnotaresourcenHowtogiveincentiveswithlimitedtonoresourcesnHowtoaddvaluethroughhappyteammembersnHowtoshowyourvaluetouppermanagement
402 David Dang,SeniorAutomationConsultant,Zenegy Technologies
optimizing Modular Test automationManycompanieshaverecognizedthevalueoftestautomationframeworks.AppropriatetestautomationframeworksmaximizeROIonautomationtoolsandminimizescriptmaintenance.Oneofthemostcommonframeworksisthemodulartestautomationapproach.Thisapproachusesthesameconceptassoftwaredevelopment:buildingcomponentsormodulessharedwithinanapplication.Fortestautomation,themodularapproachdecomposestheapplicationundertestintofunctionsormodules.Thefunctionsormodulesarelinkedtogethertoformautomatedtestcases.Whilethis
44 : 4 5 p m – 6 : 0 0 p m
Overthepast15yearsTodd Schultzhastestedmanytypesofsoftware,inmanyindustries.ToddSchultzispassionateaboutprofessionaldevelopment;mentoringQualityAssuranceEngineerswhoseeQAasacareer,andnotjustajob.
Dan Downingteachesloadtestingandoverthepast13yearshasledhundredsofperformanceprojectsonapplicationsrangingfromeCommercetoERPandcompaniesrangingfromstartupstoglobalenterprises.
David DangisanHP/MercuryCertifiedInstructor(CI)forQuickTestProfessional,WinRunner,andQualityCenterandhasprovidedautomationstrategyandimplementationplanstomaximizeROIandminimizescriptmaintenance.
Brian Copelandhasbeeninstrumentalinthetestingofcriticalbusinesssystems,frommissioncriticalapplicationstocommercialsoftware.
Bradley BairdisanSQAprofessionalandhasworkedatseveralsoftwarecompanieswherehehascreatedSQAdepartmentstestlabsfromscratch,trainedtestteamsandeducatedstakeholderseverywhereonthevaluesofSQA.
CONFERENCE FALL 2 012
P a g e 1 9
approachencouragesreusabilityandmaintainability,therearemanychallengesthatmustbeconsideredandaddressedatthestartofaproject.
ThispresentationdescribesthekeyfactorstheQAgroupneedstoconsiderduringthedesignphaseofimplementingamodulartestautomationapproach.TheQAgroupwilllearntheaspectsofthemodulartestautomationapproach,thebenefitsofimplementingamodularapproach,thepitfallsofamodularapproach,andbestpracticestofullyutilizethemodularapproach.
403 Dan Downing,PrincipalConsultant,Mentora Group
Interpreting Performance Test Results – Part 2Inthesecondpartofthissession,wewilltrytocodifytheanalyticstepswewentthroughinthefirstsessionwherewelearnedtoobserve,formhypotheses,drawconclusionsandtakestepstoconfirmthem,andfinallyreporttheresults.TheprocesscanbestbesummarizedinaCAVIARapproachforcollectingandevaluatingperformancetestresults:
nCollectingnAggregating
nVisualizingnInterpreting
nAnalyzingnReporting
Wewillalsodiscussanapproachforreportingresultsinaclearandcompellingmanner,withdata-supportedobservations,conclusionsdrawnfromtheseobservations,andactionablerecommendations.Alinkwillbeprovidedtothereportingtemplatethatyoucanadoptoradapttoyourowncontext.Comepreparedtoparticipateactively!
404 Brian Copeland,QAPracticeDirector,Northway Solutions Group
agile vs fragile: a Disciplined approach or an excuse for ChaosTheManifestoforAgileSoftwareDevelopmentwassignedoveradecadeagoandestablishesasetofprinciplesaimedatincreasingthespeedatwhichcustomerscanrealizethevalueofadevelopmentundertaking.WhiletheprinciplesofAgilearearefreshingfocusondelivery,theyareoftenhijackedtobecomeanexcusefortheundisciplineddevelopmentorganization.TheAgileframework’sfocusonagilityisanythingbutundisciplinedwithprinciplessuchasTestDrivenDevelopment(TDD);howeverroguedevelopment
organizationshavepointedtoAgileastheimpetustoabandonallvestigesofprocess,documentation,andinmanywaysquality.Theseorganizationshaveaddedafifthprincipletothemanifesto:SpeedoftheDeliveryoverqualityofthedelivered.
Session Takeaways:
nAgileorFragile:HowtotellwhichyourorganizationisnAgileCharacteristics:Thecharacteristicsof
excellentAgileteamsnAgileManifesto:Whatdoesitmeanforprocesses
anddocumentation?nAgileTesting:Theroleof“independent”testingin
theAgileframeworknAgileTools:Dotestingtoolshaveaplacein
Agiledevelopment?nAgileFaçade:Strategiesforbreakingdownthefaçade
405 Todd Schultz,ManagingSeniorQualityAssuranceEngineer,Deloitte Digital
Mobile software Testing experienceInthishands-onsession,withdevicesinhand,wewillinvestigatetheissuesthatmobiletestersdealwithonadailybasis.Wewillexplorebothmobileoptimizedwebsitesandnativeapplications,inthenameofconsumeradvocacyandcontinuousimprovementandgainanewperspectiveonthemobilecomputingeraaswearmourselveswiththeknowledgeneededtousherinaqualityfutureforthisemergingmarket.
Thissessionwillfocusonthreeofthebiggestchallengesinmobileapplicationtesting:
nDeviceTesting–Devicefragmentationisachallengethatwillcontinuetoincrease,andfulldevicecoverageisoftencostprohibitive.Wewillinvestigatehowdevicefragmentationaffectsqualityandlearntheconsiderationsinvolvedindevicesamplingsize.
nConnectivityTesting–Althoughsomeapplicationshavesomeformofofflinemode,mostweredesignedwithconstantconnectioninmindandcanbenearuselesswithoutaconnectiontotheinternet.Wewillinvestigatehowvitalconnectivityistotheproperfunctioningofmanymobileapplicationsandexplorevarioustestingmethodologies.
nInterruptTesting–Phonecalls,textmessages,alarms,pushnotificationsandotherfunctionalitywithinourdevicescanhaveaseriousimpactontheapplicationundertest.Wewillinvestigatethetypesofissuestheseinterruptionscancauseandsomestrategiesfortesting.
P a g e 2 0
session block
regiSTer www.STPCon.com or call 877.257.9531
partofthisinauguraleffort.ThepurposeofthistwopartsessionistoreviewahighlevelstudyofthebuildingofaTestCenterofExcellencewithinamatureITorganizationthatwillbeinformativeforcompaniesofvarioussizesandgrowthrelatedtoQualityAssurancematurity.
Session Part 1
nTheStartup–thissessionwilldescribehowthetestingcenterwasformedinitially,stepstakentobuildtheteam,baseliningtheprocessandmethodologydocumentation,initialmetricsplannedforreporting,theprocessinvolvedinselectingthepilotbusinessareasthatwouldbesupportedandhowwepreparedtheorganizationforthechanges.
nWhatWorked–wewillreviewthedecisionsmadeduringtheinitialstages,thosedecisionsthatstoodwiththeteamthroughouttheprocess,andhowtheorganizationwassocializedwiththestakeholders
Session Takeaways:
nDocumentingcoreprocessesrequiredtobuildateamnSelectingtheappropriateteammemberskillsets
whenbuildingateamnIdentifyingcorerequirementswhenselectinga
testingvendornEstablishingcoremetricsneededfortheorganizationnSelectingthepilotgroup/businessareafortestingservices
502 Dwight Lamppert,SeniorTestManager,Franklin Templeton
How to Prevent DefectsThesessionshowshowtopreventdefectsfromleakingtolaterstagesoftheSDLC.Thisisasuccessfulcasestudyinwhichawarenessandfocusonstatictestingwasincreasedoveraperiodof2years.Defectdetectionandleakageremovalmetricsweretrackedforeachoftheprojects.Thefirst2projectsexposedsomeissues.Themetricsweresharedanddiscussedwithbusinesspartners–andvariousprocessimprovementswereimplemented.Theresultsonthe4subsequentprojectsshowedmarkedreductionsindefectsthatleakedintosystemtestingandproduction.Thequalityimprovementalsocontributedtolesscostandshortertimelinesbecausere-workwascontrolled.
Session Takeaways:
nAfocusondocumentationreviews,walk-throughs,andinspectionsisacriticalfirststepforbuildingqualityintothecodeearlyintheSDLC
Mark Tomlinsonisasoftwaretesterandtestengineer.Hisfirsttestprojectin1992soughttopreventtrainsfromrunningintoeachother–andMarkhasmetaphoricallybeenpreventing“trainwrecks”forhiscustomersforthepast20years.
Mike Lyleshas19yearsofITexperience.HiscurrentrolecomprisesTestManagementresponsibilitiesforamajorcompanydomaincoveringStoreSystems,SupplyChain,MerchandisingandMarketing.
Dwight Lampperthasover15yearsofsoftwaretestingexperienceinthefinancialservicesindustryandcurrentlymanagesSoftwareTestingProcess&MetricsatFranklinTempleton.
Brad Johnsonhasbeensupportingtesterssince2000asheadofmonitoringandtestproductsatCompuware,MercuryInteractiveandBorlandandisnowwithSOASTAwherehedeliverscloudtestingontheCloudTestplatform.
Doug HoffmanisatrainerinstrategiesforQAwithover30yearsofexperience.Histechnicalfocusisontestautomationandtestoracles.Hismanagementfocusisonevaluating,recommending,andleadingofqualityimprovementprograms.
1 0 : 3 0 a m – 1 1 : 4 5 a m
5
Wednesday17 october
501 Mike Lyles, QAManager,Lowe’s Companies, Inc.
building a successful Test Center of excellence – Part 1In2008,Lowe’sinitiatedaQualityAssurancegroupdedicatedtoindependenttestingforIT.ThiswasLowe’sfirsttimeseparatingdevelopmentandtestingeffortsforthe62-year-oldcompany.MikeLyleswasprivilegedtobe
P a g e 2 1
CONFERENCE FALL 2 012
nDefectmetricsareessentialtosupportthingsthattestingexposeseverydayandarethebasisforinitiatingprocessimprovementdiscussions
nWhenawarenessofstatictestingisincreasedontheprojectteam,theindividualsparticipatingoftenstopcreatingdefectsastheyspecify,program,andtestthenewfunctionality
nTheQAorganizationisthebestgrouptopromoteprocessesthatbuildqualityintocodeearlyintheSDLC
503 Brad Johnson,VPProductandChannelMarketing,SOASTA
The Testing Renaissance Has arrived (on an iPad in the Cloud)Thisisthebesttimeinhistorytobeatester!Emergingfromthemostsignificanteconomic“darkage”sincetheGreatDepression,theworldtestersnowfaceisoneofimmenseopportunityandchallengeascloudcomputinghasblowninovernightandmobiledeviceshaveovertakentheplanet.Inthenewworldofspeedandscale,RenaissanceTestersarelaunching(orre-launching)theircareersbytestingtransformationaltechnologiesbyeffectivelyutilizingthosesametransformationaltechnologies.
Attendthissessiontolearnhowyoucancatapultyourcareerwithcloud-basedtestautomationandmobiletestingtechniquesthatareasexcitingtolearnanduseastheyareimpactfultoyourendresultsandpersonalsuccess!
Attendees Will Learn To:
nBecomeacloudtestingexpertnBuildandarticulateadistributedmobile
testingstrategynChampionanewapproachtorealistic,repeatable
webandmobileperformancetestingnEstablishyourselfasanagiletestingexpert
withContinuousTestingnDefend“Test”inaworldheadingtoward“DevOps”
Learnthenew“arts”–embracethisnewworld–andbecomeaRenaissanceTester!
Session Takeaways:
nLearnwheretestersaremakingalastingimpactonstrategicprojects
nIdentifyareastofocusonforcareergrowthnLearntoseekoutstrategicprojectsnGainperspectiveandoptimismaboutthefuture
504 Doug Hoffman, Consultant,Software Quality Methods
non-Regression Test automation – Part 1Theprincipleadvantagesofautomatedtestsarerepeatabilityandspeed.Theprincipledisadvantagesarethattheyarerelativelymoreexpensivetocreatethanmanualtests,requiremoremaintenancethanmanualtests,andaremorelimitedinthespecificityofthingstheycancomparecomparedwithmanualtests.Part1ofthispresentationdescribesanotherwaytoapproachtestautomation:totestthingsthatcannotbetestedmanually.Thesetestsenableustofocusonlearningaboutthesoftware,cangobehindtheUItoextendourreach,arenotlimitedtodoingthesamethingeachtimeandcanperformhugenumbersofiterationsandcombinationsunthinkableusingmanualtestingorautomatedregressiontests.Thisapproachalsoencouragescheckingbroaderclassesoftestoutcomes,thusimprovingthetypesoferrorsthatcanbediscovered.
Session Takeaways:
nHowtouseautomatedteststoextendtesters’capabilitiesnThevirtues/drawbackstoautomatedregressiontestsnDesignofautomatedtestsforexplorationnAmodelforunderstandingoutsideinfluencesand
hiddenoutcomesduringtesting
505 Mark Tomlinson,OwnerandCEO,West Evergreen Consulting, LLC
slow-Motion Performance analysisEverymodern-dayperformanceengineerisnowroutinelyaskedtodiagnosetheclientsidesensitivityandvulnerabilitytoperformancefailureduetoslowpageloading,high-latencyandlimitedbandwidth.Andifyou’vereadSteveSoudersbooksyouknowthatbehindeverybrowserisawhole-lottaloadingactivitygoingon–activitywhichobeysasomewhatbizarresetoflogicalrules,dependingonthebrowsertypeandversion.Thishands-onsessionwillhelpyoulearnhowtoinvestigateclient-sideperformanceissuesbyconfiguringthebrowserandafewdifferenttoolstomakethepagerenderinslowmotion.Wewillcoverhowtoanalyzethepagesequencerenderingtohighlightobjectsormilestonesintherenderingthataresensitivetohigh-latencyperformanceissues.Wewillcoverhowtofindfunctionalityissueswiththepagethatarecausedbyslowloadingconditions.Thetechniqueslearnedinthissessionwillhelpyouinthecorecompetencyforperformanceroot-causeanalysisandtroubleshooting.
session block
P a g e 2 2
regiSTer www.STPCon.com or call 877.257.9531
Wednesday17 october
601 Mike Lyles, QAManager,Lowe’s Companies, Inc.
building a successful Test Center of excellence – Part 2In2008,Lowe’sinitiatedaQualityAssurancegroupdedicatedtoindependenttestingforIT.ThiswasLowe’sfirsttimeseparatingdevelopmentandtestingeffortsforthe62-year-oldcompany.MikeLyleswasprivilegedtobepartofthisinauguraleffort.ThepurposeofthistwopartsessionistoreviewahighlevelstudyofthebuildingofaTestCenterofExcellencewithinamatureITorganizationthatwillbeinformativeforcompaniesofvarioussizesandgrowthrelatedtoQualityAssurancematurity.
Session Part 2
nTheEvolution–thissessionwilldiscussthemanychangesthatanevolvingtestingteamtypicallytakes,thestepstowardmaturityinsomeareas,theprocessesusedtobuildanonboardingroadmap,andsocializingthebenefitsandvalueoftheorganizationtootherITandbusinessgroups.
nWhatWorked–wewillreviewwhattheteamlearnedalongthewayandalsoevaluatehighlevelprocessesandproceduresthatwereeffectivefromthebeginningbutevolvedastheteamgrewovertheyears
Session Takeaways:
nBuildinganeffectiveroadmapforonboardingadditionalgroups/areas
nBestpracticesforsocializingthetestinggroupwithotherITteamsandobtainingbuy-in
nEstablishingaQualityBoardtomonitor,govern,andapprovechangestotheprocessesandtestingmethodologies
nIntegratingothergroupswithtestingorganizationsnSpotlightingtheneedforrelevance–growingthe
testingorganizationwithemergingtechnologies
602 Fariba Marvasti, Sr.QAManagerII,Aetna
aetna Case study – Model officeTheModelOfficeProgramcameintoexistenceduetoacontractualstipulationofanewlyforgedAetna
61 2 : 0 0 p m – 1 : 1 5 p m
Robert Walsh, aproponentofAgilesoftwaredevelopmentprocessesandtechniques,believesstronglyindeliveringqualitysolutionsthatsolverealcustomerproblemsandprovidetangiblebusinessvalue.
Scott Moore hasover18yearsofITexperiencewithvariousplatformsandtechnologiesandhastestedsomeofthelargestapplicationsandinfrastructuresintheworld.
Mike Lyleshas19yearsofITexperience.HiscurrentrolecomprisesTestManagementresponsibilitiesforamajorcompanydomaincoveringStoreSystems,SupplyChain,MerchandisingandMarketing.
Doug HoffmanisatrainerinstrategiesforQAwithover30yearsofexperience.Histechnicalfocusisontestautomationandtestoracles.Hismanagementfocusisonevaluating,recommending,andleadingofqualityimprovementprograms.
Fariba Alim-MarvastileadsaninnovativeorganizationdrivingProcessimprovementsacrossAetnawithdeliveryresponsibilityfortesting/qualityassurancewithintheInformaticsandMedicalManagementdomains.
CONFERENCE FALL 2 012
P a g e 2 3
partnershipwithakeyvendorpartner.TheProjectteamrecognizedthatModelOfficewasnottraditionalITtesting.ThisnewtestinghadverylittletodowiththeconventionalITaspectbutinsteadwasallaboutBusinessProcessvalidation.Itwaspromptlyidentifiedthatthistypeoftestingwasnotinthecurrentportfoliooftestingservicesandthereforewouldrequireanewmethodologyandanewteamtoexecuteit.
ThenewlyestablishedModelOfficeteamsuccessfullyexecutedModelOfficetestingforseveraloftheProgram’sworkstreamssinceitsinceptioninearly2011.ModelOfficetestingisaninnovativefocusonBusinessprocessanalysisandconcentrationonriskidentification.Itwasrecognizedthatthereisobviousbenefitinprogramscomprehendingrisksandenablingproactivemitigation.AsaresultitwasdeterminedthatModelOfficetestingbeanavailableoptiontoallprogramsacrosstheenterprise.
TheModelOfficeProcesscanbedescribedintofourphases:Engagement;Assessment;Execution;andMonitorandReview.
603 Scott Moore,President&CEO,Northway Solutions Group
application Performance Test Planning best PracticesManycompaniesexperienceperformanceissuesinproductionevenaftertheyhavetestedittoendureload.Why?Thissessionwilldemonstratethevalueofperformancetestingforreal-worldscenariosandhowtoproperlyplanforyourapplication’s“perfectstorm”.Howtocreateandreacttochaosbeforeithappensinproductionwillbeexplored.Attendeeswilllearntriedandtrueguidelinesthatcanusedtoplanforrealisticpeakloadsandunderstandwhatworstcaselookslikebeforecustomersdo.Inaddition,wewilldiscusshowcloudarchitectureandSoftware-As-A-Serviceintroducesnewproblems.Attendeeswillwalkawaywitharepeatabletestexecutionmethodologytouseonanyperformancetestingprojectinthefuture.
604 Doug Hoffman,Consultant,Software Quality Methods
non-Regression Test automation – Part 2Automatedsoftwaretestinghashistoricallymeanthavingthecomputerrunindividuallycraftedtestcasesthat
performthesameexercisesasmanualtests,onlyrunbyamachine.Theprincipleadvantagesfortheseautomatedtestsarerepeatabilityandspeed.Theprincipledisadvantagesarethattheyarerelativelymoreexpensivetocreatethanmanualtests,requiremoremaintenancethanmanualtests,andaremorelimitedinthespecificityofthingstheycancomparecomparedwithmanualtests.
Part2ofthispresentationdescribesoraclemechanismsthatenabletesterstotakeadvantageofnon-regressionautomation.Theoraclesdeterminewhetherthesoftware’sbehaviorappearstobenormalorerroneous.Theoraclesallownon-regressionteststovarytheirbehaviorandstillhavepredictable,checkableoutcomes.Thissessionpresentsoveradozendifferenttypesoforaclemechanisms.
Session Takeaways:
nTestoraclemechanismsforautomatedtests
605 Robert Walsh,SeniorConsultant,Excalibur Solutions, Inc.
Keeping Up!OneofthechallengesmanyorganizationsfacewhenadoptingAgileprocessesishavingenoughtimeineachiterationtotestwhatwasdevelopedinthatiteration.Developerswanttoworkuptothelastminuteintheiterationtofinishstoriesandmaximizebusinessvalue.Further,astheprojectgrowsovertime,thescopeofthetestingeffortgrowswithit.HowcananorganizationensureitremainstruetoAgilewithoutsacrificingquality?
Thissessionwillprovidesomehelpfultipstogivetestersthebestchanceofkeepingpacewithdevelopment.Additionally,thepresenterwilldiscussseveralstrategiesthatmaybeemployedif,despitevaliantefforts,testingfallsbehind.Whilenosingleapproachmayprovidethesilverbulletsolution,attendeeswillleavethesessionarmedwithideasandconceptsfordealingwiththeproblembothproactivelyandreactively.
Key Takeaways – You will learn:nGainanunderstandingofthechallengestestersfacein
fast-pacedAgile/iterativedevelopmentenvironmentsnLearnseveralstrategiestohelpthemhaveabetter
chanceofkeepingpacewithdevelopmentnLearntwospecificwaystoadapttheirprocessesif
theydiscovertheycannotkeeppacewithdevelopmentnLearneffectivewaystodealwithdefectsfoundin
differentphasesofAgiletesting
P a g e 2 4
session block
regiSTer www.STPCon.com or call 877.257.9531
Wednesday17 october
701 Lee Henson, ChiefAgileEnthusiast,AgileDad
Technical Debt: a Treasure to Discover and DestroySometreasuresareworththeplunderastheyyieldvastamountsofrichesandjewels.Othertreasuresareoftenbetterleftuntouched.Thissessionisaboutatreasurethatnoorganizationwantstoseeorfacebuttherewardsforacknowledginganddestroyingthetreasureisvastandbountiful.Aswecontinuetoseecompaniesgrowandexpand,organizationsarebuildingVERYstrongfeaturesetsatopacrumblingarchitecturalfoundation.Learnwhatthesevendeadlysinsoftechnicaldebtare,andthestepsyoucantaketoeliminatethem!Seefirsthandwhattheveryobstaclesarethatwearetryingtoavoidyetfallingrightintotheirpath.Learnwhatthetester’sroleisinhelpingtomakecertainweneverpitfallintothisenvironmentagain.Leavearmedwiththestepswecantaketoadjusttheriggingandmakecertainweneversaildownthepathofendlessdebtagain.
702 Wayne Ariola, VPofStrategy,Parasoft
Dependencies Gone Wild: Testing Composite applicationsThemovetoSOAandcompositeapplicationshasundeniablydeliveredtremendousbenefits.However,theassociateddistributionandreusecreatesvariouschallengesfromthequalityperspective.Withmanydependenciesrelyingonacentralizedendpointtocompletetheirbusinessprocesses,itbecomesessentialthatthiscomponentalwaysworkasexpected.Additionally,thefragmentationofsystemorendpointownership(orcontrol)shiftshowindividuals,thirdparties,anddependentapplicationsmustaccessandevolvetheirsystems.Moreover,ensuringthequalityofthesystemundertestiscomplicatedbythefollowingfactors:
nEnd-to-endtestsneedtopassthroughmultipledependentsystems,whicharecommonlyunavailable,evolving,ordifficult-to-accessfortesting
3 : 0 0 p m – 4 : 1 5 p m
7
Jamie Burns startedhercareerinsoftwaretesting,hasbeeninthesamedisciplineforover19yearsinsoftwaretestingandqualityassurance,andhas10+yearsintestautomation.
Matthew Heusserisaconsultingsoftwaretesterandsoftwareprocessnaturalistwhohasspenthisentireadultlifedeveloping,testing,ormanagingsoftwareprojects.
Lee Henson’s12yearsofexperiencespanabroadarrayofsoftwareproductionrolesandresponsibilities.Heiscurrentlyoneofjustover100CertifiedScrumTrainers(CST)worldwide.
Andreas Grabnerhas10yearsofexperienceasanarchitectanddeveloperintheJavaand.NETspace.Inhiscurrentrole,AndiworksasaTechnologyStrategistfordynaTraceSoftwareintheMethodsandTechnologyteam.
Wayne AriolaisVicePresidentofStrategyandCorporateDevelopmentatParasoft,aleadingproviderofintegratedsoftwaredevelopmentmanagement,qualitylifecyclemanagement,anddev/testenvironmentmanagementsolutions.
P a g e 2 5
CONFERENCE FALL 2 012
nAccessingsuchsystemsofteninvolvestransactionandbandwidthfees
nTeamsneedtotestandtunethesystemundertestagainstarealisticandbroadrangeofperformanceandbehaviorconditions
703 Andreas Grabner, TechnologyStrategist,Compuware dynaTrace
Top 3 Performance land Mines and How to address ThemAsatester,youdonothavetheluxuryorthetimetotestrepeatedlytotrytofixslow,poorly-performingapplicationsduringloadtests.Youneedtogettothecauseofperformancequicklyandfixissuesfastandefficiently.Therearetoolsthatcanhelpinidentifyingapplicationissues,butmanyarenoteffectivefortestinginanenvironmentwheretheboundariesbetweenpreproductionandproductionareincreasinglyblurred.
Thissessionwilldiscussthetop3applicationissuesthatimpactperformanceandofferloadtestingbestpracticetipsforfindingandfixingperformanceproblems.Attendeeswilllearnhowto:
nRapidlydeterminetherootcauseofproblemsdowntothecomponent,SQLstatement,orMethodlevel
nReducetestingiterationsandcycletimenValidatearchitectureformaximumscalability
704 Jamie Burns,ITTeamLead,Denver, Colorado
building automation from the bottom Up, not the Top DownMostsoftwareautomationprojectsfail.Why?Becausetesters,managers,companiesthinkautomationtoolsaremagicalandthatautomationiseasytoimplement,justrecordandplayback–right?Wrong!Toomanytimes,ITprojectsbuyintothe‘easilyautomate’softwarefromthetoolsvendoronlytofindtheyhaveshelvedthetool6monthsdowntheroad.Buildinganautomatedtestsystemtakesjustasmuchthought,designandplanningasbuildingthesoftwareapplicationundertestitself.
Beforeeventhinkingaboutanautomationtool,youmusthavethesupportinginfrastructureinplacefortestautomation.Notonlydoesthemanualtestcasehavetoberepeatable,butthewholeprocessneedstoberepeatable.Oneofthebiggestcausesofautomation
failureistryingtoautomatechaos.Youwon’tbesuccessfulatautomationifyouhaven’ttakenthenecessarystepstocreatearepeatabletestingprocess.
Session Takeaways:
nWhatarethegoalsoftesting?nTestEnvironment–isitundercontrol,
oroutofcontrol?nTestData,doyouknowwhatyouhave,
orisitconstantlychanging?nHowhaveyoubuiltyourtestcases?Arethey
independentoraretheydependent?nGetbacktobasics,developatestautomation
plananddriveautomationfromthegroundup
705 Matt Heusser, PrincipalConsultant,Excelon Development
There Can be only one: a Testing Competition – Part 1Thisdoublesessionintegratestheprevioustalksandappliesthem,simulatingrealsoftwaretesting.Afteraquickexercisetocreateteamsof2-6testers(orbringyourown),youwillbeplungedintotherealworldofsoftwaretesting:Funchallenges,deliveredundertimepressureandconditionsofuncertainty.Teamswillbejudgedoncoverage,bugsfound,thequalityofthecommunicationtheyhavewith“management”and“therestofthetechnicalstaff”,newapproachesandstrategy/leadership.Stickaroundafterthecompetition,becauseprizeswillbeawardedonthemainstageThursdaymorning.
Bringyourlaptop,yourmobiledevice,yourmind,andyourbesttestideastothishigh-pacedracefortestexcellence.Seeyouontheplayingfield.
session block
P a g e 2 6
regiSTer www.STPCon.com or call 877.257.9531
Wednesday17 october
801 Todd Schultz, ManagingSeniorQualityAssuranceEngineer,Ubermind / Deloitte
Maintaining Quality in a Period of explosive Growth – a Case studyA12yearoldsoftwaredevelopmentfirmbegancreatingiOSapplicationswithabout20employees.Lessthan2yearslatertheyhad150employeesandweremakingawardwinningiOSandAndroidapplications.Inearly2012theywerepurchasedbyoneofthebig4accountingagenciestobethemobileextensionoftheirworld-widetechnologyconsultingbusiness.
Maturingprocessinatimeofexplosivegrowthisanimmensechallenge.SincebeforetheylaunchedtheirfirstiOSapplicationtheexecutiveleadershipsoughttohirethebestandthebrightesttechnologistsandturnedthemloosetotraversetheterrainofthisfastadvancingmobileemergingmarket.Now,asapartofa188,000personcorporation,theycontinuetochallengethestatusquoandpushtheagileprocessboundaries,andcontinuemakingleadingedgemobileapplications.
ThissessionisacasestudyofoneQualityAssuranceDepartmentmanagingexplosivegrowthandbecomingtheheadlightsofanagilewhole-team.
Session Takeaways:
nSoftwaredevelopmentmethodscanmaturecontinuallyinacompanyofanysize
nCurrentqualityassurancemethodsareover30yearsoldandbadlyinneedofsomepolish
nGreatbenefitcanberealizedfromfairlysimpleprocessmodificationandrefocus
nQualityassuranceisoftenthelastdisciplinetofullyembraceagilemethods
802 Carl Shaulis, QAEngineeringManager,HomeAway.com
Testing in the World of Kanban – The evolutionInthissession,CarlShaulispresentsajourneyofateamwhoadoptedKanbanandwentfrom6weekrelease
84 : 3 0 p m – 5 : 4 5 p m
Uday Thonangihasover10yearsofexperiencetestingapplicationsbuiltforclientserver,AS400andmobileandover2yearsexperiencetesting,settingupprocesses,buildingtestenvironmentsandevaluatingtoolsformobileapplications.
Carl Shaulishasbeentestingsoftwarefor10+yearsandhasover15yearsofmanagementexperience.Carltakesananalyticalapproachtotestingandhasthefortitudetoembracechange.
Overthepast15yearsTodd Schultzhastestedmanytypesofsoftware,inmanyindustries.Toddispassionateaboutprofessionaldevelopment;mentoringQualityAssuranceEngineerswhoseeQAasacareer,andnotjustajob.
Anna Royzmanisthetestleadinacross-functionalproductdevelopmentteamthatcreatesanddeliversgame-changingsoftwareinthefinancialindustry,where“quality”isasimportantasthe“timetomarket.”
Matthew Heusserisaconsultingsoftwaretesterandsoftwareprocessnaturalistwhohasspenthisentireadultlifedeveloping,testing,ormanagingsoftwareprojects.
CONFERENCE FALL 2 012
P a g e 2 7
cyclesdowntoalmostdaily.ThissessionwillthenshiftintosecondgearillustratinghowtheteamhasevolvedthepracticeandhowKanbanmigratedtootherteams.
Session Takeaways:
nWhatisKanban?nHowdotestersplayaroleinKanban?nWhyaremoreteamsadoptingKanban?nHowtoelevateKanbantodeliverValue
803 Anna Royzman, QALead,Liquidnet Holdings, Inc.
Refocusing Testing strategy Within the Context of Product MaturitySameasthe“completepreplanningahead”isnottheAgilewayofdeliveringsoftware,thetestingstrategywithintheagileprojectneedstofine-tunetothevariousstagesofproductdevelopmentandmaturity.Whiletheteamandproductleadswanttobeconfidentaboutsoftwarequality,testingtasksandactivitiesneedtobeleanenoughtoavoidunnecessarytime/maintenancehurdlesorbottlenecks.Wewillreviewtestingmethodsandstyleswhichfitbestatdifferentstagesofproductmaturity(hint:thedefinitionof“quality”mayadjustforeachstage).Sessionhighlights:
nStrategicwaystouseautomation,andwhenmanualexploratorytestingisabetterchoice
nTestingtheusabilityandbusinessassumptionsnLeveragingexploratorytestingasateamactivity
(whenandhow)nGettingreadyforlivepilotsandsalesdemos
oftherealproductnTestingcoveragerefinementfromthe
customerfeedbacknRisk-basedtestingnTestautomation:onetooldoesn’t‘fitall’nDesigningproduction“safetynet”suiteof
automatedtests
Session Takeaways:
nRecognizingwhat“quality”meansforvariousgroupsofusersandstakeholders(Sales,Business,Product,Operations,EndUsers)
nChoosingtherighttestingstrategyandsolutionsbasedonprojectneedsandstakeholders’goals
nDiscoveringqualityrisksatdifferentstagesofproductmaturity,andfine-tuningtestingstrategyaccordingly(throughsimulationexercises)
nFormingintelligentdecisionsontesttacticsandmethodsapplicablewithincontext-specificsituations
804 Uday Thongai, SoftwareTestEngineerLead,Progressive Insurance
Mobile Testing: Tools, Techniques & Target DevicesThenatureofthemobileindustryisinconstantfluxwithnewdevices,browserandoperatingsystemversionsbeingreleasedconstantly.Mobiletestershavetokeepdevice,browserandOScombinationsinmindwithmultipleIDEsandtestingtoolstocomeupwithriskassessmentandtestapproaches.Usageofbuilt-inSDKutilities,vendortoolsandcommandlinegoodiesareexploredinthissession.Testingtooloptionsforbothnativeandmobilewebapplicationswithideasonwhatselectioncriteriashouldbeusedareshowcasedwithrecommendations.Therequiredskilllevelofmobileapplicationtestersisslightlyhigher.Forinstance,availabletestingtoolsexpectaccesstoapplicationsourcecodewithbasicknowledgeofJava/ObjectiveCfornativeappstesting;understandingofecosystems(Eclipse/AndroidSDK,Xcode/iOSSDKetc);andknowledgeofbrowsersanddifferentrenderingengineswiththeireffectonhowpagesarerenderedisessential.Thissessionwillprovideaframeworktomanageallthesedimensionsofmobiletesting.
805 Matt Heusser, PrincipalConsultant,Excelon Development
There Can be only one: a Testing Competition – Part 2Thisdoublesessionintegratestheprevioustalksandappliesthem,simulatingrealsoftwaretesting.Afteraquickexercisetocreateteamsof2-6testers(orbringyourown),youwillbeplungedintotherealworldofsoftwaretesting:Funchallenges,deliveredundertimepressureandconditionsofuncertainty.Teamswillbejudgedoncoverage,bugsfound,thequalityofthecommunicationtheyhavewith“management”and“therestofthetechnicalstaff”,newapproachesandstrategy/leadership.Stickaroundafterthecompetition,becauseprizeswillbeawardedonthemainstageThursdaymorning.
Bringyourlaptop,yourmobiledevice,yourmind,andyourbesttestideastothishigh-pacedracefortestexcellence.Seeyouontheplayingfield.
P a g e 2 8
session block
regiSTer www.STPCon.com or call 877.257.9531
Thursday18 october
901 Rakesh Ranjan,ManagerandSoftwareTestArchitect,IBM Corporation
7 Habits of Highly effective TestersAsthetitleofthetalkimplies,thespeakerwilldescribe/proposesevenhabitsofbeinghighlyeffectiveinaTester’sroleandwillpresenttechniquesforadoptingthosehabits.Atestermustmakeaparadigmshiftinhisorherjobandadoptaprofessionalattitudetowardstestingandtestengineeringprocessesingeneral.Thesession’sfocalpointisonsomeprovenapproachesforobtainingpersonalandinterpersonaleffectivenessthatarenecessarytobecomeahighlyeffectivetester.
Session Takeaways:
nLearnwhatiscausingtheparadigmshiftintestengineering
nIdentifybadassumptionsandblindspotsnDevelopcoverage,confidenceandcommonsensein
youreverydayjobnUsemathematicsandstatisticstomeasureresults
andeffectivenessnUnderstandthepsychologyoftesting
902 Matt Heusser,PrincipalConsultant,Excelon Development
advances in software Testing – a Panel DiscussionIfthepaceofdevelopmentandtechnologyaretwotothreetimesasfast,whatnewadvancesarehappeninginsoftwaretesting?Themoderatorwillpolltopicsfromtheaudience,thenusetheK-CardMethodtoevaluatetheattentionoftheroom,expandingontopicstheroomwouldliketodiscussandmovingonasenergyfades.
FromCloudComputingtoMobile,LeanSoftwareTestingtoExploratoryTestAutomation,Crowdsourcedtesting,privacyandsecurity,thisadvancedsessionissuretoprovideinsightsintotoday’schallengesinsoftwaretesting–andhowtosolvethem.Inadditiontotalkingpoints,eachexpertwillprovideapapersummaryforallattendees,includingpointersandlinks.
Mark Tomlinsonisasoftwaretesterandtestengineer.Hisfirsttestprojectin1992soughttopreventtrainsfromrunningintoeachother–andMarkhasmetaphoricallybeenpreventing“trainwrecks”forhiscustomersforthepast20years.
Sreekanth Singaraju hasmorethan12yearsofseniortechnologyleadershipexperienceandleadsAlliance’sQA&Testingorganizationindevelopingcuttingedgesolutions.
Rakesh RanjanmanagesahighperformanceTestEngineeringandQAteamforIBM’sflagshipdatabaseproductDB2andhasover16yearsofsoftwaredesign,developmentandtestexperience.
Matthew Heusserisaconsultingsoftwaretesterandsoftwareprocessnaturalistwhohasspenthisentireadultlifedeveloping,testing,ormanagingsoftwareprojects.
Jean Ann HarrisonhasbeenintheSoftwareTestingandQualityAssurancefieldforover12yearsincluding4yearsworkingwithinaRegulatoryEnvironment.Hernicheissystemintegrationtesting,specificallyonmobilemedicaldevices.
91 0 : 1 5 a m – 1 1 : 3 0 a m
P a g e 2 9
CONFERENCE FALL 2 012
Session Takeaways:
nAsummaryofcutting-edgeissuesinsoftwaretesting,alongwithcutting-edgesolutions
nAhandfulofideastotryonMonday,somewithlittleornocost
nAbalanceddiscussionofhowthoseideashaveworkedforavarietyofexperts
nReferencesforwheretogoformore
903 Mark Tomlinson,PerformanceGuru,West Evergreen Consulting, LLC
Performance Testing Metrics and MeasuresThissessionwillcovertheexpansiveunderstandingofperformancetestingmetricsandhowtheycanbeusedtodrivequalityinitiativesupstreamanddownstreamintheapplicationlifecycle.Toooftentodayweseethatperformancemeasurements(CPU,DISK,MEMORY,NETWORK)areleftoutofearlytestingautomationandpass/failcriteria,whenitwouldbeabsolutelymorecost-effectiveifwecouldfindandfixthosebottlenecksearlier.Testerswhoarenewtoperformancetestingsuccesscriteriawilllearnnewwaystocorrelateandanalyzeperformancemeasurementsandextrapolatetheresultsinareliableandrepeatableway.Testerswhoareinterestedintakingtheirbug-findingskillstoawholenewlevelwillbedelightedtoexpandintoperformance-relatedtestinginvestigation,explorationandriskanalysis.
904 Sreekanth Singaraju,VP,QAandTestingServices,Alliance Global Services
How and Where to Invest Your Testing automation budgetTestautomationpromisessubstantialbenefitstoanorganizationincludingacceleratedtestcycles,increasedcoverage,accuracyinreportingandenhancedproductivity.Thereality,however,isthatinmanycases,automationprojectsfailbeforetheydeliverprojectedROIortheysubstantiallyunder-performontheobjectives.Thissessionwillcoverfiveprovenstrategiesforasuccessfultestingautomationstrategyandhowtobestallocateyourtestautomationbudget.
Session Takeaways:
nApracticalguidetodevelopingasuccessfulautomationstrategyincludingwheretospendyourbudgetdollarsandallocateresources
nCasestudiesoutliningstrategiestochoosingthefollowing:End-to-Endscenarios,AutomationFrameworks,ImplementationApproachesandTestData
nDefinitionsofmetricsandhowtocapturethemtovalidatethatyourstrategiesareworking
905 Jean Ann Harrison, ProjectManager,ProjectRealms, Inc.
Memory, Power and bandwidth – oh My! Mobile Testing beyond the GUIManytesterstodayareaskedtotestmobileapplications.Theassumptionistotestthemobileapplicationinthesamemanneroftestingawebapplicationoraclient/serverapplication.However,ifthesoftwaretesteristestingmobileapplications,thenthesoftwaretestermustnowbecomeawareofhardwareandfirmwareconditionswhichwerenotnormallyapartofprevioustestcasedevelopment.Chargingthedevicewhilethesoftwareapplicationisbeingdownloaded,installing,inusewheretheGUIisengagedareallnecessarytestsforthemobileapplicationtester.Addanothervariabletochargingthedevicetoconsidertheheatgeneratedfromchargingthebattery,anotherleveloftestscanincludenetworkcommunication,databasesearches,andmemorymanagement.Understandingthecombinationofsoftware/firmware/hardwareallcontainedwithinonecomplexsystemisnowapartofanysoftwaretesterofmobileapplications.
Testerswillworkinteamstoformulateheuristicoraclesbyintroducingvarioushardwareconditionstotheirmobiledevicesandwitnessingdifferentsoftwarebehaviors.Wewilluseexercisestodeveloptestcasesusingexploratorytestingtofurtherinspireheuristicoracles.Theresultwillgenerateaseriesofregressiontestideastoapplyforanymobileapplicationtestingproject.
session block
P a g e 3 0
regiSTer www.STPCon.com or call 877.257.9531
Joseph Oursdrawson15years’experienceprovidingexecutive-levelleadershipwhilemanaginghighprofileinitiativeswithademonstratedabilitytoleadpeopletowardssuccessfuldelivery.
Philip LewisanAdjunctProfessoratAlaskaPacificUniversityandtheProjectManagementCollegeteachinggraduatecoursesinsoftwareengineering,ITprojectmanagement,andITGovernance.
Richard Kriheli’scareerspansfifteenyearsofqualityassuranceanddesignonaccountssuchasWalmart,L’Oreal,Nokia,Vogue,BestBuy&others.HecurrentlyheadstestingeffortsforNikeatR/GA.
Dan BartowisVPofProductManagementatSOASTA,theleaderinperformancetestingfromthecloud.PriortojoiningSOASTAhewasSr.EngineeringManageratIntuit.
1 1 : 4 5 a m – 1 : 0 0 p m
10Scott BarberisCo-FounderoftheWorkshoponPerformanceandReliability,andco-authorofPerformanceTestingGuidanceforWebApplications,BeautifulTesting,andReducingtheCostofTesting.
Thursday18 october
1001 Joseph Ours,DirectorofSoftwareQAandTestingServices,Cohesion
Redefining the Purpose of software TestingThroughoutthehistoryofsoftwaretesting,theprofessionhasevolvedfromexpectationsofjustmeetingrequirementstoensuringfitnessofuse.Alongtheway,testershavebeensaddledwiththeburdensomeexpectationsofensuringoverallqualityineachoftheseways.Inthispresentationwewilldiscussthehistoryofsoftwaretestinginordertounderstandwheretheindustryneedstogo.Wewilltalkaboutthecommonchallengesourstakeholdershaveinunderstandingourcraft,aswellassomeofthecommonnegativeperceptionsofvalue.Wewilladdressthesewithanewlydefinedpurposeofsoftwaretesting,wheretheemphasisisplacedonprovidinginformation,notjustrawdata,tostakeholders;informationofvalue.Thistransitiontoprovidinginformationwilltransformtestingintoaservicemindedgroupwhosevalueistransparentandultimatelyempoweredbytheirstakeholdersinsteadofjusttoleratedbythem.
Session Takeaways:
nTheevolutionofsoftwaretestingnAnewdefinitionforthepurposeofsoftwaretestingnHowtodelivervaluetostakeholdersinordertobe
empoweredbythemnAbetterdefinedtestingrolethatalignswith
businessvalue
1002 Philip Lew, CEO,XBOSoft
evaluating and Improving UsabilityToday’sweb-basedapplications(WebApps)containingcomplexbusinesslogicandsometimescriticaltooperatingthebusiness,nowmusthaveanincreasedfocusonusabilityaswellasthenewerandbroaderterm,userexperience.Now,mobileappsarefollowingtheirleadandaregainingmoreandmoresophisticatedfunctionalityevenwithlimitedscreenrealestate.Thishasledtobothusabilityanduserexperiencebecomingparamountasthereisnoup-frontinvestmentforcingausertostay.EventhoughusabilityhassomeformalISOmodeldefinitions,
CONFERENCE FALL 2 012
P a g e 3 1
therearenomodelsorformaldefinitionsforuserexperience,noritsrelationtousability.Forusability,ISOprovidesgeneralguidelinesbutlacksimplementationspecifics.UX,ontheotherhand,doesnothaveanyformalstandarddefinition,althoughsomemodelshavebeendevelopedregardingitselements.Modelsandresearchhavebeenusedmostlyforthepurposeofunderstanding,ratherthanevaluatingandimproving.Inthistalk,wedrawrelationshipsbetweenusabilityanduserexperienceanddiscussmeasurementandevaluationmethodsthatcanbeusedasthefirststeptowardimprovement.
Session Takeaways:
nUnderstandusabilityanddevelopausabilitymodelnUnderstandwhyitisimportantandhowitimpacts
useracceptancenMethodologyforcontinuoususabilityimprovementnPracticalmeasurementsnLearnhowoneorganizationconductedusability
testingviaacasestudy
1003 Dan Bartow, VicePresident,ProductManagement,SOASTA
Real World Performance Testing in ProductionOnlineapplicationperformanceiscritical–noonewouldchallengethisstatement.Yetthe“dirtylittlesecret”inthewebworldisthattheamountofperformancetestingdoneonapplicationsisappallinglylow.Whenperformancetestingisdoneit’susuallyconductedinatestlab.Evenwiththoroughtestinginalabenvironment,whenapplicationsaredeployedtoproductiontheyveryfrequentlytoppleunderthepressureofreal-wordusers.Theresultsfromthisinvestmentinlabtestingarenotdeliveringtheanswersthatleadershipneedsaboutwebapplicationperformance.
Testinginproductionisanessentialcomponentofworld-classperformancemethodologies.However,thisapproachisnotwithoutitsownsetofchallenges;thethreemostcommonofwhicharesecurity,testdatainproduction,andpotentiallivecustomerimpact.Inthissessionyou’lllearnkeyelementsfromthemethodologythatcompaniesareusingtoenableproductiontestingandsubsequentlygainthehighestconfidencepossibleintheirproductionapplicationperformanceandreliability.CometothissessionandlearnhowbusinessesfromtheNewYorkStockExchangethroughNetflixhavesolvedtheseproblemstoenableongoingproductiontesting.
1004 Richard Kriheli,AssociateDirectorofQualityAssurance,R/GA
scaling Gracefully and Testing ResponsivelyThewebisn’tjustdesktopanymore.Thewebiseverywhere,creatingafluidconundrumfortheQAprofessional.Asthetestingmatrixgrowsandgrowsintoamultiplatformexpanse,wemustbereadyfornotjustthesizeofascreen,butalsouserbrowsinghabits.Inthissession,we’llexploretheproblemspresentedbyresponsivedesign,examinetheflexiblegridandforecastsystematicsolutions.
Session Takeaways:
nWalkawaywithanenhancedunderstandingofthenuancesofanincreasinglyfluidweblandscape
nGetanoverviewofresponsivewebdesignandarecommendedapproachtotestbeyondthedesktop
nWitnessthevariouspermutationsoftheflexiblegridappliedtoarangeofplatforms
1005 Scott Barber,ChiefTechnologist,PerfTestPlus
Quick, easy & Useful Performance Testing: no Tools RequiredWhenmostpeoplethinkofperformancetesting,theythinkaboutthehardpartsandabouttheexpensiveandcomplicatedtoolsthatarerequiredtosimulatetheactivityofthousandsofend-usersallatthesametime,whilecollectingtensorhundredsofthousandsofmeasurements.Inreality,manyperformanceissuescanbedetectedanddiagnosedwithexactlythetoolsandknowledgeyoualreadyhaveatyourdisposalusinginformationobtainedfromquick,easyandcheapperformancetests.Infact,muchoftheperformancerelatedinformationthatstakeholdersneedtomakegooddecisionsanddevelopmentteamsneedtodramaticallyimprovesystemperformanceiseasilyobtainablebytheperformance-testinglayman.
Scottwillintroduceyoutoseveraltechniquesthattheperformancetestinglaypersoncanusetospeedupandsimplifythecollectionofvaluableperformance-relatedinformation;manyofwhichyoucanuseduringthetutorialtotestyourcurrentwebsiteifit’saccessiblefromtheclassroom.
Session Takeaways:
nWhatperformancetestingcanbedonequickly&easilynTheresourcesnecessarytodoitnTheexperienceofhavingdoneit
PRSR
TST
DU.
S.P
OSTA
GE
PAID
PERM
IT#
6563
SLC
UT8
4115
RegisteR N O W !DiscountsEarlyBirdDiscount:RegisteronorbeforeSeptember7toreceive$400.00offanyfullconferencepackage
Team Discounts
Number of Attendees
Rate Before Early Bird
(9/7)
Rate After Early Bird
(9/7)
1-2 $1,295 $1,695
3-5 $1,195 $1,395
6-9 $1,095 $1,295
10-14 $995 $1,195
15+ $895 $1,095
*Price above is for access to the Main Conference Package. Please add $400 to your registration if you are registering for the Main Conference Package PLUS 1-Day.
**Team discounts are not combinable with any other discounts/offers. Teams must be from the same company and should be submitted into the online registration system on the same day.
regiSTer @www.STPCon.com
or call 877.257.9531
50 Conference breakout sessions in 8 Comprehensive Tracks
1115
Elk
ton
Driv
e,S
uite
301
nC
olor
ado
Sprin
gs,C
O80
907
leadership Perspectives for Testers
strategic business alignment
Test strategy, Process and Design
Performance Testing
Test automation
agile Testing
Mobile application Testing
Hands-on Practicals