CSTE - Testing New Technologies by Yogesh Khairnar
-
Upload
yogesh-khairnar -
Category
Documents
-
view
39 -
download
2
Transcript of CSTE - Testing New Technologies by Yogesh Khairnar
TESTING NEW TECHNOLOGIES
Skill Category 10
Testing New Technologies
Risks Associated with New Technology
Newer IT Technologies that Impact Software Testing
Testing the Effectiveness of Integrating New Technology
Risks Associated with New Technology
Questions we must ask Is new technology utilized on the project being
tested? If so, what are the concerns and risks
associated with using that technology? If significant risks exist how will the testing
process address those risks?
Risks Associated with New Technology
1. Unproven technology There is not enough experience
2. Technology is defective It doesn’t work like it should
3. Inefficient technology It fails to achieve the productivity gains associated with
it.
4. Technology incompatible with other implemented technologies It might not be useful if you can’t incorporate it with
existing technologies
5. New technology obsoletes existing implemented technologies We should assume that because of the new technology,
some old technology will probably be classified as obsolete
Risks (cont)6. Variance between documentation and technology
execution The documentation may be inaccurate leading to
believing that the technology is inefficient.7. Staff not competent to use new technology
Training may be required and deployment processes will most likely need to be updated
8. Lack of understanding how to optimize the new technology Not all aspects of it may be used, therefore the company is
missing something9. Technology not incorporated into the
organization’s work processes It may be hit or miss. Typical at technology maturity Level
110.Obsolete testing tools
New testing tools and new methodologies may be required11. Inadequate vendor support
The vendor may not be as helpful as IT would like
Newer IT Technologies that Impact Software Testing
Web-Based Applications Distributed Application Wireless Technologies New Application Business Models New Communication Methods New Testing Tools
Web-Based Applications
Consists of hardware, software, and users Having an understanding of its
components leads to better testing Understanding the interaction between the components
offers a different perspective than that of the developers
Client based components are on the front end Web browsers, plug-ins, and embedded objects
Server Side components are on the back end Web server components, database applications, third-
party modules, and cross-component communication
Distributed Application
Components are grouped into clusters of related services
Traditional Client-Server Systems UI, Business logic code, Data-access service code, Data
Storage Thin-client system
Majority of processing is done on the server UI is usually the only part that runs on the client Testing should focus on server and network
performance Thick-client system
Majority of processing is done on the client ActiveX and Java applets run on the client, instead of
the server Testing should focus on client performance and
compatibility
Wireless Technologies
Common Issues Electromagnetic interference and physical
obstacles that limit coverage of wireless network Specific Issue:
Standards Constraints in deployment of Wireless Network
since multiple standards are exist Data security
WLANs use different authentication and encryption methods
Throughput or Coverage The farther you get from a transmitter or access
point, the throughput of the network decreases
New Application Business Models
e-Commerce Buying and selling of goods & services, and
the transfer of funds, through digital communications.
e-Business The conduct of business on the Internet Buying and selling of goods, servicing
Customers and collaborating with business partners
Web sites that are elaborate brochures
New Communication Methods
Voice and Messaging Cell-phones, pagers, and commercial two-way
business radios Analog standard is AMPS Digital standards are GSM, TDMA, CDMA FCC allocates different frequencies to different carriers 3G will provide 30-times faster transfer rates
Interoperability issues galore Hand-Held and Internet-Enabled Devices
Internet-enabled cell phones and PDAs Limitations include: Low bandwidth, low quality of
service, high cost, the need for additional equipment, and high utilization of devices’ battery power
Data Networking WLANs and broadband wireless
New Testing Tools – Test Automation
Test Automation is the use of software to control the execution of tests, the comparison of actual outcomes to predicted outcomes, the setting up of test preconditions, and other test control and test reporting functions
Often seen as a time saver Testing frameworks are also used
JUnit and NUnit Helped to drive test driven development
Partial automation tools are useful as well Product installation, test data creation, GUI interaction,
problem detection, defect logging
Testing the Effectiveness of Integrating New Technologies
Determine the Process Maturity Level of the Technology
Test the Controls over Implementing the New Technology
Test the Adequacy of Staff Skills to Use the Technology
Determine the Process Maturity Level of the Technology
1. People-Dependent Technology The technology is available to use by individuals at their
discretion2. Use Description-Dependent Technology
Processes There are processes in place for the technologies use,
but projects can vary from those processes if desired3. Use of Technology
The processes are determined to be effective and compliance to those processes are required
4. Quantitatively Measured Technology Once the processes are determined to be effecting, they
should be measured – need to make sure that the data collected is reliable before optimizing processes
5. Optimized Use of Technology The data from level 4 will enable the optimization of the
use of technology
Test the Controls over Implementing New Technologies Testing actual performance vs. Stated
performance Does the technology accomplish its stated benefits? Assumptions about new technology don’t have the
experience behind them that older technologies have Documentation represents actual technology execution Training courses transfer the needed knowledge to use
the technology New technology is compatible with existing technology Stated performance criteria represent actual
performance criteria Promised vendor support equals actual vendor support Expected test processes and tools are effective in
testing new technologies
Test the Controls over Implementing New Technologies Test the Adequacy of the Current
Processes to Control the Technology Do implemented work processes assure the technology
will be used in an effective and efficient manner? Work Process – Standards, Procedure, and Quality
Control Compliance – Management’s desires that workers follow
the procedures Enforcement – What happens when procedures aren’t
followed
If testers determine that processes are not adequate Identify risk and report it Identify potentially ineffective parts of the process Conduct tests to identify specific problems and
assessing the potential impact on the end product
Test the Adequacy of Staff Skills to Use the Technology
Professional processes have two parts Process itself Competency of the process user to use that process
effectively
To test the adequacy of Staff skills to use the new technology tester should look into: Technological process maturity level Training available in the new technology The performance evaluation of individuals to use the new
technology
THANKS
YOGESH KHAIRNAR