Dell Built in Ev Do Business Class Competitive Analysis 2007

8/9/2019 Dell Built in Ev Do Business Class Competitive Analysis 2007

1/13

Integrated EV-DO Comparison for Dell, Lenovo and HP 1

December 2007www.veritest.com [email protected]

Built In EV-DO Comparison for Dell,Lenovo and HP

Test report prepared under contract from Dell Inc.

Executive Summary

Dell Inc. commissioned VeriTest, thetesting service of LionbridgeTechnologies Inc., to conduct acompetitive analysis comparing theperformance of built-in EV-DO (Rev-A)mobile broadband modules usingVerizon Wireless BroadbandAccess.VeriTest conducted a series of tests tofind which notebook had the bestperformance in terms of overall datathroughput speed and performance. Thenotebooks tested in this study includethe following Business Class models.

Business Classo Dell Latitude D630o HP 6910po Lenovo T61

The Dell Latitudes EV-DO Rev-Amoduleis manufactured by Novatel. TheHP and Lenovo EV-DO Rev-A modulesare made by Sierra Wireless. Each ofthe notebooks tested had comparableconfigurations (e.g., processor speed,memory, and system OS). All notebooksincluded Intel Core 2 Duo processors aswell as 2 GB (2 x 1GB) of random

access memory (RAM). For a list of complete specifications for each notebook, please refer toAppendix A.

In order to best replicate the end user experience, each notebooks operating system type wasinstalled according to what is used the most from a business perspective. Business class modelsincluded Microsoft Windows XP Professional with Service Pack 2.

Key Findings

Average Download Speed

Chart 1. Average Kbps for FTP and Web Downloading.

On average, the Dell D630 download speeds were 36%faster than the HP 6910p and 88% faster than theLenovo ThinkPad T61.


2/13


Tests were conducted in the following US cities over a 29 day period using Verizon WirelessBroadbandAccess.

San Diego, California

New York, New York

Chicago, Illinois

Three test locations were used in each city. All notebooks were tested on the same day for eachlocation. Each location was tested on separate days to account for network variability. The finalresult for each test was calculated by averaging the encountered results from multiple testiterations for each location. Six (6) to ten (10) iterations were conducted for each test.

The following tests were conducted:

A. Web Downloading Test - to measure throughput when downloading 1MB and 2MBweb files via HTTP protocol.

B. FTP Send and Receive Test - to measure throughput when transferring 1MB and2MB files to and from web servers via FTP protocol

Upon completion, the study findings show that on average, the Dell Latitude D630 provided 36%more throughput than the HP 6910p and 88% more throughput than the Lenovo ThinkPad T61 fordownload speed.

The Dell Latitude D630 had an average throughput speed averaged across the FTP and WebDownloading tests of 1023 Kbps. The HP 6910p had an average throughput of 753 Kbps and theLenovo T61 had an average throughput of 545 Kbps.

Please refer to the Test Methodology section of this report for complete details of how testing wasconducted. All units were tested using default factory settings. Lionbridge confirmed that allnotebook computers were new and unopened prior to testing and ensured all tests werecompleted with impartiality.

Test Results

The following section details the results from testing.

Web Download ThroughputGoal: Benchmark throughput when performing web downloads via HTTP using a low traffic serverhosted by a local internet service provider.

Summary of Results: The Dell Latitude D630 was on average 43% faster than the HP 6910p and74% faster than the Lenovo T61 when downloading a 1MB zip file from the web. The Dell D630

was on average 27% faster than the HP 6910p and 80% faster than the Lenovo T61 whendownloading a 2MB zip file from the web.


3/13


0

100

200

300

400

500

600

700

800

900

1000

1100

KilobitsPerSecond

1MB 2MB

Web Download Comparison

Dell

HP

Lenovo

Chart 2: Average Kbps for all test run averages for the Web Downloading Test.

Notebook 1MB(Kbps) 2MB(Kbps)

DELL D630 1012.66 989.18

HP 6910p 707.29 780.47

LENOVO T61 582.48 550.79Table A. Average Throughput of Web Downloading Test

FTP TestGoal: Benchmark throughput when using FTP to transfer files.

Summary of Results: The Dell D630 was on average 43% faster than the HP 6910p and 94%faster than the Lenovo T61 when downloading a 1 MB zip file via FTP. The Dell D630 was onaverage 32% faster than the HP 6910p and 106% faster than the Lenovo T61 when downloadinga 2 MB zip file via FTP.

Upload results displayed minimal variance in performance. The Dell D630 was on average 10%faster than the HP 6910p and 5% faster than the Lenovo T61 when uploading a 1 MB zip file viaFTP. The Dell D630 was on average 13% faster than the HP 6910p and 3% faster than theLenovo T61 when uploading a 2 MB zip file via FTP.


4/13


0

100

200

300

400

500

600

700

800

900

1000

1100

KilobitsPerSecond

1MB snd 2MB snd 1MB rcv 2MB rcv

FTP Throughput Comparison

Dell

HP

Lenovo

Chart 3: Average throughput for all test run averages for the FTP Test.


DELL D630 1066.27 1024.86

HP 6910p 746.47 776.21

LENOVO T61 549.36 497.78Table B. Average Download Speed of FTP Test


DELL D630 631.13 623.39

HP 6910p 571.36 549.68

LENOVO T61 601.45 602.39Table C. Average Upload Speed of FTP Test

Test Methodology

Dell Inc. commissioned VeriTest to conduct a competitive analysis comparing performance ofbuilt-in EV-DO (Rev A) mobile broadband modules. VeriTest conducted a series of throughputtests to measure which notebook had the highest performance.

Notebook ConfigurationsTest conditions were designed for the notebooks to be as close to an out-of-the-box configurationas possible, but some third party software, such as firewalls and virus protection, had to bedisabled. This ensured that some of this software did not affect download speed.


5/13


The following software was required for testing which needed to be installed:

o Wget for DOS (an application distributed under the GNU license) for the non-interactiveWeb Downloading Test.

Test Locations

The test locations included areas with low, marginal, and strong coverage. Locations used weredeemed typical for users of built-in mobile broadband and included hotels and coffee shops.Some locations provided unreliable connections resulting in data with such large standarddeviations as to be statistically useless. Data from these locations was not used in this report.Several test runs would take 8 hours or more requiring the availability of AC power to keep thenotebooks charged, however, notebooks tested were not connected to AC power during testing.

Test Run ConditionsTo keep the testing notebooks from possessing any advantages over each other based onlocation, orientation or configuration, the test design called for the following conditions to be metbefore testing could begin:

o Each computer must be placed in the same point of origin and facing the same directiono

Each LCD monitor must be tilted back at approximately 110 degreeso Each computer must be running on battery only, to simulate a typical user experienceo Power settings must be set to Always Ono All brightness settings must be maximizedo Device radios are to be powered off unless when under test

There are many factors affecting actual throughput analysis (e.g. structures, latency, and networktraffic). Because these factors were out of our control and testing was not done in a controlledlab the results may not be reproducible. The tests were designed to be objective by ensuring thateach notebook was affected by the same or similar environmental factors.

Test Run DetailsAfter test setup was complete and all test run conditions were met, all notebook tests wererepeated from six (6) to ten (10) iterations. A completed iteration is defined as a single testexecuted once on all three notebooks. Interleaving the tests from notebook to notebook helpedensure that any network traffic or signal fluctuations would affect all notebooks equally minimizingfactors that can cause network variance such as network traffic. Only one computer wasconnected to the Verizon Wireless BroadbandAccess service at a time. Only one notebookmodule was powered on at a time. The test run was complete when all iterations were completefor all tests.

Calculating AverageOnce a test run was complete, the recorded data points for each test location were averaged.These results can be found in Appendix C: Detailed Results.

Test Details

The following describes each test in detail and includes information on test development,description of execution and data gathering.


6/13


A. Web Downloading Test

Test DescriptionWget for DOS was used to download a 1 megabyte and 2 megabyte zip file from a website. Zip files were used to eliminate the possibility of file transfer compression affectingtest results.

Test DevelopmentThe Wget application was installed on each notebook. A batch file executed the Wgetcommand with the logging option to download the two zip files and log the results. Thezip files were located on a low traffic web server from a local ISP.

Test Execution and Data GatheringDouble clicking the batch file would run the test. A log file was created on the desktopupon completion. The start and stop time data as well as the Kb/s from each downloadwere recorded into an Excel spreadsheet to be averaged.

B. FTP Test

Test Description

FTP is one of the most common methods for transferring large files over the internet. Totest throughput speeds via FTP, Microsoft XPs integrated FTP client was used todownload and upload a 1 megabyte zip file and a 2 megabyte zip file. Zip files were usedto eliminate the possibility of file transfer compression affecting test results.

Test DevelopmentA batch file was written to log onto an FTP server and run put/get commands whichwould send and receive the files via FTP then log the results to a log file on the Desktop.The FTP server used for this test was provided by a low traffic local ISP.

Test Execution and Data GatheringDouble clicking the batch file would run the test. Upon completion a log file was createdon the desktop. The time in seconds it took for each download and upload to complete as

well as the Kb/s were copied into an Excel document in order to be averaged.


7/13


Appendix A: System Configurations

System Information Dell Latitude D630

Processor/speed Intel Core 2 Duo 2.00GHz

System Ram/type/number of slots 2 GB (2x1GB)

Mother board manufacturer Dell Latitude D630Built-in EV-DO Rev A Module Manufacturer Novatel

OEM OS Win XP + SP2Table D. System configuration for Dell Latitude D630

System Information HP Compaq 6910p



Mother board manufacturer HP Compaq 6910p

Built-in EV-DO Rev A Module Manufacturer Sierra Wireless

OEM OS Win XP + SP2Table E. System configuration for HP Compaq 6910p

System Information Lenovo ThinkPad T61



Mother board manufacturer Lenovo ThinkPad T61

Built-in EV-DO Rev A Module Manufacturer Sierra Wireless

OEM OS Win XP + SP2Table F. System configuration for Lenovo ThinkPad T61

Appendix B: Testing Software Information

Software Version Associated Test Description

Microsoft FileTransfer Program

5.1.2600.2180 FTP TestThis is an application integrated intoWindows XP and was used to test

throughput via FTP protocol.

Wget 1.8.2

WebDownloading

Test

This is an application which isdistributed under the GNU General

Public license and was used toretrieve files (non interactive) via

HTTP protocol.Table G. Testing software information


8/13


Appendix C: Detailed Results

The following section details the results from each test run. All numbers contained herein areaverages from all the test iterations executed during that run as described in the TestMethodology section. Please refer to that section for more details.

San Diego, CA Test Location 1:Testing Location: Tuesday, November 6, 2007 Starbucks (Mission Beach) San Diego, CAAddress: 4343 Mission Blvd # 104, San Diego, CA 92109

Details: Testing took place inside on the southwest side of the lobby area. This area included anearby power outlet on the wall. The nearest Verizon Wireless tower is approximately 1.5 milesnorth from this location. This location was observed as a low to moderate signal reception area.

HTTP Download FTP Test

1MB Down 2MB Down 1MB Up 2MB Up 1MB Down 2MB Down

AVG344.46 326.62 347.84 385.13 323.84 330.62DELL STDEV 68.72 70.10 89.81 97.99 81.49 94.24

AVG 263.95 278.00 420.50 436.98 376.30 306.24HP

STDEV 91.31 75.46 209.87 167.03 148.26 105.27

AVG 435.28 472.73 428.27 397.18 346.48 285.73LENOVO

STDEV 54.75 76.42 53.72 119.03 118.58 77.71

San Diego, CA Test Location 2:Testing Location: Thursday, November 8, 2007 Archstone La Jolla Colony San Diego, CAAddress: 7205 Charmant Dr. San Diego, CA 92122

Details: Testing took place in a covered outdoor area with access to AC power. This is located inthe southeast area of the complex. This location was deemed as a moderate to good signalcoverage area.


1MB Down 2MB Down 1MB Up 2MB Up 1MB Down 2MB Down

AVG 1427.52 1333.84 658.61 653.16 1771.57 1667.83DELL

STDEV 332.10 324.52 44.76 30.67 322.88 349.09

AVG 976.45 1143.38 578.63 642.08 1346.77 1514.65HP

STDEV 288.86 233.16 53.61 22.69 611.42 450.60

AVG 136.87 883.42 582.68 629.12 975.55 882.99LENOVO

STDEV 136.87 86.45 26.24 48.97 136.00 107.59


9/13


San Diego, CA Test Location 3:Testing Location: Saturday, November 10, 2007 Westfield Shopping Town San Diego, CAAddress: 1640 Camino Del Rio N, San Diego, CA 92108

Details: Testing took place in the Westfield Mall in Mission Valley. This location is near theNational University Marine Corps Recruit Depot and DeVry University. There is an in-building

Verizon Wireless tower at this location. Notebooks were tested in the food court area of the mallwith nearby access to AC power.


1MB Down 2MB Down 1MB Up 2MB Up 1MB Down 2MB Dow

AVG 840.49 746.74 564.87 567.12 1214.65 1074.07DELLSTDEV 192.40 159.17 62.17 66.65 642.26 649.68

AVG 481.37 393.45 519.53 415.81 374.65 449.80HP

STDEV 124.68 82.00 171.89 138.27 112.55 128.28

AVG 547.27 603.27 456.27 414.37 393.81 348.11

LENOVO STDEV 132.03 106.55 130.64 121.14 88.02 72.73

New York, NY Test Location 1:Testing Location: Wednesday, November 14, 2007 Radisson Martinique Hotel New YorkAddress: 49 W.32

ndStreet, New York, NY 10001

Details: Testing took place in the restaurant area of the hotel. This is on the first floor of the hotel(street level). The Radisson Hotel is approximately mile from the nearest Verizon Wirelesstower, but there is a fair amount of structural interference as well as a high amount of networktraffic. This location was deemed as a good coverage area based upon preliminary throughputtests.



AVG 1458.48 1432.54 711.12 670.11 1262.25 1295.68DELLSTDEV 158.09 136.05 98.96 88.48 93.93 98.13

AVG 665.04 780.89 550.29 535.67 767.00 733.20HP

STDEV 203.25 97.59 113.41 155.01 186.36 189.97

AVG 441.43 462.20 740.67 761.16 487.35 452.16LENOVO

STDEV 48.67 24.63 30.16 22.88 38.10 46.74


10/13


New York, NY Test Location 2:Testing Location: Friday, November 16, 2007 Staten Island Ferry Station New YorkAddress: South Ferry State Street & Whitehall Street, New York, NY

Details: Testing took place in the main entrance area. No nearby AC power was available. Thisarea is approximately 1/2 mile south of Wall Street as well as the Castle Clinton National

Monument. This location was observed to be a moderate to good signal coverage area.



AVG 863.52 709.07 791.07 792.79 983.31 840.55DELLSTDEV 114.48 54.57 9.18 23.62 163.33 64.65

AVG 617.80 627.23 660.57 675.19 646.03 638.35HP

STDEV 149.79 70.52 70.72 25.61 177.53 46.80

AVG 458.72 469.89 713.45 752.29 562.65 468.00LENOVO

STDEV 56.43 50.72 70.69 46.45 33.62 25.60

New York, NY Test Location 3:Testing Location: Sunday, November 18, 2007 Starbucks New YorkAddress: 378 6

thAve, New York, NY 10011

Details: Testing took place in the lobby area at the northwest corner of the building near theentrance. This location is next to New York University and Washington Square Park. The nearestVerizon Wireless tower is approximately 1 mile west of the location. This location wasobserved as a low to moderate signal coverage area with average network traffic.

HTTP Download FTP Test1MB Down 2MB Down 1MB Up 2MB Up 1MB Down 2MB Dow

AVG 1135.12 1031.90 416.32 426.20 1122.55 1101.01DELLSTDEV 202.93 146.48 66.21 69.70 136.38 110.92

AVG 559.24 607.28 301.09 316.08 537.23 588.31HP

STDEV 150.86 91.21 149.78 140.30 116.94 225.21

AVG 518.20 510.27 302.61 324.88 519.24 482.77LENOVO

STDEV 44.55 45.61 106.79 94.66 27.72 31.53


11/13


Chicago, IL Test Location 1:Testing Location: Thursday, November 29, 2007 Starbucks ChicagoAddress: 15 S Prospect Ave, Park Ridge, IL 60068

Details: Testing took place in the lobby area of the building with close access to AC power. Thereare approximately ten (10) schools within a mile radius of the location. The nearest Verizon

Wireless tower is approximately 200 yards east of this location. This location was observed as amoderate to good coverage area.



AVG 1135.12 1164.27 807.44 794.71 1152.08 1172.11DELLSTDEV 79.94 41.93 4.30 16.38 45.08 45.79

AVG 1063.45 1113.49 739.00 748.48 1065.63 1087.89HP

STDEV 49.15 36.73 24.99 26.83 138.48 143.36

AVG 725.35 572.89 751.28 764.73 595.07 594.44LENOVO

STDEV 255.44 27.94 19.36 8.12 32.00 19.81

Chicago, IL Test Location 2:Testing Location: Saturday, December 1, 2007 Radisson Hotel ChicagoAddress: 1450 East Touhy Avenue, Des Plaines, IL 60018

Details: Testing took place in the lobby area of the hotel in the east part of the building. This areais approximately 2 miles from the nearest Verizon Wireless tower. This location was observed asa moderate coverage area.



AVG 955.09 901.94 766.36 753.89 1069.35 979.45DELLSTDEV 106.24 70.00 10.68 13.71 52.71 62.62

AVG 647.75 708.01 776.55 758.25 641.60 658.92HP

STDEV 66.41 40.27 9.40 23.17 99.34 67.57

AVG 605.44 535.97 757.03 760.37 580.03 551.95LENOVO

STDEV 21.32 57.89 24.51 17.72 8.16 19.71


12/13


Chicago, IL Test Location 3:Testing Location: Monday, December 3, 2007 Airport, OHare ChicagoAddress: Not Available

Details: Testing took place in the upper level main area of Terminal 3. There was no access toAC power. This area was observed as a low to moderate coverage area with high network traffic.



AVG 1081.57 1242.37 616.59 567.37 696.81 762.47DELLSTDEV 341.52 179.74 48.52 79.00 208.18 233.18

AVG 873.25 1067.24 596.04 418.59 963.03 1008.51HP

STDEV 269.49 302.28 194.51 255.73 407.09 348.34

AVG 449.87 412.19 680.81 617.40 484.11 413.91LENOVO

STDEV 53.34 59.03 38.21 75.77 35.17 89.10


13/13


All references, in part or in full, to test results presented in this report must directly reference orlink to this complete report. All references should be made to this report which will be posted inthe competitive analysis test section of the Lionbridge web site.

Disclaimer of Warranties; Limitation of Liability:

VERITEST HAS MADE REASONABLE EFFORTS TO ENSURE THE ACCURACY AND VALIDITY OF ITSTESTING, HOWEVER, VERITEST SPECIFICALLY DISCLAIMS ANY WARRANTY, EXPRESSED ORIMPLIED, RELATING TO THE TEST RESULTS AND ANALYSIS, THEIR ACCURACY, COMPLETENESSOR QUALITY, INCLUDING ANY IMPLIED WARRANTY OF FITNESS FOR ANY PARTICULAR PURPOSE.ALL PERSONS OR ENTITIES RELYING ON THE RESULTS OF ANY TESTING DO SO AT THEIR OWNRISK, AND AGREE THAT VERITEST, ITS EMPLOYEES AND ITS SUBCONTRACTORS SHALL HAVE NOLIABILITY WHATSOEVER FROM ANY CLAIM OF LOSS OR DAMAGE ON ACCOUNT OF ANY ALLEGEDERROR OR DEFECT IN ANY TESTING PROCEDURE OR RESULT.IN NO EVENT SHALL VERITEST BE LIABLE FOR INDIRECT, SPECIAL, INCIDENTAL, ORCONSEQUENTIAL DAMAGES IN CONNECTION WITH ITS TESTING, EVEN IF ADVISED OF THEPOSSIBILITY OF SUCH DAMAGES. IN NO EVENT SHALL VERITEST'S LIABILITY, INCLUDING FORDIRECT DAMAGES, EXCEED THE AMOUNTS PAID IN CONNECTION WITH VERITEST'S TESTING.VERITEST AND THE VERITEST LOGO ARE REGISTERED TRADEMARKS OF LIONBRIDGETECHNOLOGIES. DELL, THE DELL LOGO, AND LATITUDE ARE REGISTERED TRADEMARKS OF DELLINC. OTHER COMPANIES NAMES ARE USED HEREIN FOR IDENTIFICATION PURPOSES ONLY ANDBELONG TO THEIR RESPECTIVE OWNERS.

Dell Built in Ev Do Business Class Competitive Analysis 2007

Documents

Transcript of Dell Built in Ev Do Business Class Competitive Analysis 2007