Advanced Diagnostics, IntelliTrace™ and Test Automation
description
Transcript of Advanced Diagnostics, IntelliTrace™ and Test Automation
![Page 1: Advanced Diagnostics, IntelliTrace™ and Test Automation](https://reader036.fdocuments.us/reader036/viewer/2022062315/568164cc550346895dd6eef7/html5/thumbnails/1.jpg)
Advanced Diagnostics, IntelliTrace™ and Test AutomationHabib Heydarian ([email protected])http://blogs.msdn.com/habibhProgram ManagerMicrosoft Corporation
PDC09-FT16
![Page 2: Advanced Diagnostics, IntelliTrace™ and Test Automation](https://reader036.fdocuments.us/reader036/viewer/2022062315/568164cc550346895dd6eef7/html5/thumbnails/2.jpg)
VS2010: Quality as a 1st Class Citizen
1 2
34
![Page 3: Advanced Diagnostics, IntelliTrace™ and Test Automation](https://reader036.fdocuments.us/reader036/viewer/2022062315/568164cc550346895dd6eef7/html5/thumbnails/3.jpg)
It Works on My Machine!
File Bug
Resolve as“No Repro”
Hand-offto Test
Test Code Hand-offto Dev
Investigate Bug
Write Code
![Page 4: Advanced Diagnostics, IntelliTrace™ and Test Automation](https://reader036.fdocuments.us/reader036/viewer/2022062315/568164cc550346895dd6eef7/html5/thumbnails/4.jpg)
What is IntelliTrace?
+ =
Application Instrumentation Log File
Today
+ ==
IntelliTrace • Record• Playback• Rewind
IntelliTrace
![Page 5: Advanced Diagnostics, IntelliTrace™ and Test Automation](https://reader036.fdocuments.us/reader036/viewer/2022062315/568164cc550346895dd6eef7/html5/thumbnails/5.jpg)
IntelliTrace: How Did I Get Here?
Habib HeydarianProgram ManagerVisual Studio
demo
![Page 6: Advanced Diagnostics, IntelliTrace™ and Test Automation](https://reader036.fdocuments.us/reader036/viewer/2022062315/568164cc550346895dd6eef7/html5/thumbnails/6.jpg)
IntelliTrace Capabilities> Code is instrumented dynamically> Records program execution flow
> Method Enter & Exit> Records program data
> Parameters> Return values
> Low overhead for collection> Supports Dev, Test and Staging
environments> Pay-as-you-go collection model> 1st class debugging experience in VS
![Page 7: Advanced Diagnostics, IntelliTrace™ and Test Automation](https://reader036.fdocuments.us/reader036/viewer/2022062315/568164cc550346895dd6eef7/html5/thumbnails/7.jpg)
IntelliTrace: Why did this Build Verification Test (BVT) test fail?
Habib HeydarianProgram ManagerVisual Studio
demo
![Page 8: Advanced Diagnostics, IntelliTrace™ and Test Automation](https://reader036.fdocuments.us/reader036/viewer/2022062315/568164cc550346895dd6eef7/html5/thumbnails/8.jpg)
How IntelliTrace WorksApplication
IntelliTrace File
CollectionPlan.xml
IntelliTrace Recorder
![Page 9: Advanced Diagnostics, IntelliTrace™ and Test Automation](https://reader036.fdocuments.us/reader036/viewer/2022062315/568164cc550346895dd6eef7/html5/thumbnails/9.jpg)
Choose the Right Tests
![Page 10: Advanced Diagnostics, IntelliTrace™ and Test Automation](https://reader036.fdocuments.us/reader036/viewer/2022062315/568164cc550346895dd6eef7/html5/thumbnails/10.jpg)
Automated
Testing
Manual Testing
User Testing
Choosing the Right TestsThe Problem
Application Functionality
Q: Which tests should the developer and tester run to verify this code change?A) Automated Tests
onlyB) Manual Tests onlyC) All of the aboveD) Don’t knowE) Trick question??
Δ
Code Change
![Page 11: Advanced Diagnostics, IntelliTrace™ and Test Automation](https://reader036.fdocuments.us/reader036/viewer/2022062315/568164cc550346895dd6eef7/html5/thumbnails/11.jpg)
Choosing the Right TestsThe ConsequenceThe world of Developers> Run more tests than
needed> Run too few tests than
needed
The world of Testers> Verify more tests than
needed> Verify too few tests than
needed
1. Less Productivity• Effort wasted on tests that don’t need to be
run2. Lower quality• Not enough testing to verify code change
![Page 12: Advanced Diagnostics, IntelliTrace™ and Test Automation](https://reader036.fdocuments.us/reader036/viewer/2022062315/568164cc550346895dd6eef7/html5/thumbnails/12.jpg)
What is Test Impact Analysis?> Automatically pinpoint which tests are
impacted as a result of a code change What is the impact
of this bug fix?
![Page 13: Advanced Diagnostics, IntelliTrace™ and Test Automation](https://reader036.fdocuments.us/reader036/viewer/2022062315/568164cc550346895dd6eef7/html5/thumbnails/13.jpg)
Test Impact Analysis: A One Line Bug Fix
Habib HeydarianProgram ManagerVisual Studio
demo
![Page 14: Advanced Diagnostics, IntelliTrace™ and Test Automation](https://reader036.fdocuments.us/reader036/viewer/2022062315/568164cc550346895dd6eef7/html5/thumbnails/14.jpg)
How Test Impact Analysis Works
Automated Impacted Tests
Test Impact View
TFSTeam Build
Manual Impacted Tests
Microsoft Team & Lab Mgr
Team Build Report
A B
C
![Page 15: Advanced Diagnostics, IntelliTrace™ and Test Automation](https://reader036.fdocuments.us/reader036/viewer/2022062315/568164cc550346895dd6eef7/html5/thumbnails/15.jpg)
Multi-Tier Performance Analysis
Client-side Script Database calls
![Page 16: Advanced Diagnostics, IntelliTrace™ and Test Automation](https://reader036.fdocuments.us/reader036/viewer/2022062315/568164cc550346895dd6eef7/html5/thumbnails/16.jpg)
Multi-Tier Performance AnalysisUser: “Why is it taking so long to load the Orders
page?”
Developer: “I wonder where the
problem could be???”
Front End?
Mid Tier?
Back End?
![Page 17: Advanced Diagnostics, IntelliTrace™ and Test Automation](https://reader036.fdocuments.us/reader036/viewer/2022062315/568164cc550346895dd6eef7/html5/thumbnails/17.jpg)
Performance Analysis Across Multiple Tiers
Habib HeydarianProgram ManagerVisual Studio
demo
![Page 18: Advanced Diagnostics, IntelliTrace™ and Test Automation](https://reader036.fdocuments.us/reader036/viewer/2022062315/568164cc550346895dd6eef7/html5/thumbnails/18.jpg)
Solve Complex Debugging Tasks
![Page 19: Advanced Diagnostics, IntelliTrace™ and Test Automation](https://reader036.fdocuments.us/reader036/viewer/2022062315/568164cc550346895dd6eef7/html5/thumbnails/19.jpg)
Collaborative Debugging
Habib HeydarianProgram ManagerVisual Studio
demo
![Page 20: Advanced Diagnostics, IntelliTrace™ and Test Automation](https://reader036.fdocuments.us/reader036/viewer/2022062315/568164cc550346895dd6eef7/html5/thumbnails/20.jpg)
DataTipsPin the DataTip to the source code
DataTip stays in sync with the source code
Toolbar allows the user to pin/unpin a DataTip
Context menu for managing values/expressions in the DataTip
Floating DataTips can be dragged anywhere, and can’t be pinned unless over source code
Space provided for comments in the DataTip which can be collapsed/expanded as desired
DataTip changes color to indicate it is a floating window
![Page 21: Advanced Diagnostics, IntelliTrace™ and Test Automation](https://reader036.fdocuments.us/reader036/viewer/2022062315/568164cc550346895dd6eef7/html5/thumbnails/21.jpg)
Debugging a Crash in a Deployed Application using Dump Files
Habib HeydarianProgram ManagerVisual Studio
demo
![Page 22: Advanced Diagnostics, IntelliTrace™ and Test Automation](https://reader036.fdocuments.us/reader036/viewer/2022062315/568164cc550346895dd6eef7/html5/thumbnails/22.jpg)
Dump File Summary PageDump file summary information
Support for mixed-mode dump files
IL Interpreter for managed property evaluation
Operating system and CLR version information
Module Information
Search modules
![Page 23: Advanced Diagnostics, IntelliTrace™ and Test Automation](https://reader036.fdocuments.us/reader036/viewer/2022062315/568164cc550346895dd6eef7/html5/thumbnails/23.jpg)
Summary
• IntelliTrace • Test Impact Analysis
• Tier Interaction Profiling• Client-side Script Profiling
• Collaborative Debugging• Debugging Dump Files
![Page 24: Advanced Diagnostics, IntelliTrace™ and Test Automation](https://reader036.fdocuments.us/reader036/viewer/2022062315/568164cc550346895dd6eef7/html5/thumbnails/24.jpg)
YOUR FEEDBACK IS IMPORTANT TO US! Please fill out session evaluation
forms online atMicrosoftPDC.com
![Page 25: Advanced Diagnostics, IntelliTrace™ and Test Automation](https://reader036.fdocuments.us/reader036/viewer/2022062315/568164cc550346895dd6eef7/html5/thumbnails/25.jpg)
Learn More On Channel 9> Expand your PDC experience through
Channel 9
> Explore videos, hands-on labs, sample code and demos through the new Channel 9 training courses
channel9.msdn.com/learnBuilt by Developers for Developers….
![Page 26: Advanced Diagnostics, IntelliTrace™ and Test Automation](https://reader036.fdocuments.us/reader036/viewer/2022062315/568164cc550346895dd6eef7/html5/thumbnails/26.jpg)
© 2009 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
![Page 27: Advanced Diagnostics, IntelliTrace™ and Test Automation](https://reader036.fdocuments.us/reader036/viewer/2022062315/568164cc550346895dd6eef7/html5/thumbnails/27.jpg)