ZDNet
 

WebBench 1.1

What's new

Installing

Running

Viewing results

Creating tests

Neat tricks

Solving problems

Screens & menus

 

BatteryMark 2.0

WEBBENCH(TM) 1.1 README.WRI

This is the README.WRI file for WebBench 1.1. You can view this file from the Windows Write program. This file contains the WebBench License Agreement, installation instructions, and important notes about WebBench.

Before you run WebBench, you must first read and agree to the License Agreement. We include this License Agreement in this file, in the WebBench documentation, and also when you run WebBench for the first time.

What's in This README.WRI File

This README.WRI file contains the following sections:

* License Agreement for Ziff-Davis' WebBench(TM) Version 1.1
* Getting the Files You Need
* Installing WebBench(TM) Version 1.1
* Where to Find Detailed Installation Instructions
* What's New About WebBench 1.1
* Important WebBench Notes
* Documentation
* Technical Support
* Trademarks

LICENSE AGREEMENT FOR WEBBENCH(TM) VERSION 1.1

READ THIS AGREEMENT CAREFULLY BEFORE USING THE SOFTWARE EMBODIED IN THE WEBBENCH(TM) 1.1 CD-ROM, OR, IF PRELOADED ON YOUR HARD DRIVE, DOWNLOADED OR IF PROVIDED AS PART OF A COLLECTION, THE PRELOADED, DOWNLOADED OR COLLECTED FILE(S) (the "Media"). Embodied in the WebBench(TM) 1.1 Media is the WebBench(TM) version 1.1 computer programs and related documentation (the "Software"). Ziff-Davis Inc., having a place of business at One Park Avenue, New York, New York 10016 ("Ziff-Davis"), is the licensor under this Agreement and you are the licensee. By using the Software, in whole or in part, you agree to be bound by the terms of this Agreement. If you do not agree to the terms of this Agreement, promptly return the Software to Ziff-Davis Benchmark Operation at 1001 Aviation Parkway, Suite 400, Morrisville, North Carolina 27560 (or, if downloaded or preloaded on your hard drive, delete the Software, or if provided as part of a collection, cease use of the Software). Title to the software and all copyrights, trade secrets and other proprietary rights therein are owned by Ziff-Davis. All rights herein, except those expressly granted to you in this Agreement, are reserved by Ziff-Davis.

1. Limited License

This Agreement grants you only limited rights to use the Software. Ziff-Davis grants you a non-exclusive, non- transferable license to use the Software on a Web server networked with multiple PC computers for the sole purpose of conducting benchmark tests to measure the performance of computer hardware and Web server software. You have the right to make a single copy of the Software for archival purposes and the right to transfer a copy of the Software across an internal local area network only to the PC computers attached to such network; provided, however, that all such copies are considered Software hereunder, that all uses of such copies are governed by the terms and conditions of this Agreement and that you shall be responsible for all uses of such copies in violation of the terms and conditions of this Agreement. Ziff-Davis hereby grants you the right to publish, except in any country where a third party claims during the term of this license that such publication infringes that party's proprietary rights, benchmark test results obtained by you from your use of the Software, provided that with the publication of each such result you:

A. Identify Ziff-Davis, the name and version number of the benchmark Software used and the name of the test suite used in the test (i.e., Ziff-Davis' WebBench(TM) version 1.1 with the standard test suite ZD_STATIC_V11.TST);

B. Identify for the Web server the exact name and version number of the Web server software package, any tunable parameters (e.g., logging) you set (unless you used the default values), the exact name, number of processors, processor speed (including clock speed) and type(s), amount of processor level 2 (L2) cache, amount of RAM, type of I/O bus, number and type of hard disk controller(s), size of hardware hard disk cache, if any, number and type of hard disks, hard disk size, type of disk organization (e.g., RAID 5), driver version of the disk controller(s), number and type of network controllers, driver version of network controller, network operating system name and version, and any relevant modifications to the default network operating system parameters (e.g., ABC Inc. Web X with logging disabled running on WXY Corp. Model 466 with a dual 166-MHz Pentium® processor, 512KB L2 cache, 128MB of RAM, bridged PCI/EISA I/O bus, WXY Integrated Drive Array disk controller, 4 ABC 1.2GB disk drives, RAID 0 hardware striping, a xxxxxxxx.dsk 12,621 4/29/96 disk driver, WXY 100BaseT network controller, a WXY 100BaseT driver version X.X, Microsoft® TCP/IP, Microsoft Windows® Sockets Version 1.1, Windows NT® Server 3.51);

C. Identify for the client testbed the network type, the number of clients, the client operating system version and service pack version, if any, (e.g., Microsoft Windows 95 or Windows NT 3.51 with Service Pack 1), the client CPU type and speed in percentages, amount of RAM, the number and type of hubs/concentrators, the number of clients per segment, client network software name and version (drivers, protocols, redirector; e.g., Microsoft TCP/IP, Microsoft Windows Sockets Version 1.1, > NE2000.386), client network card, size of the client network cache, if any (e.g., 100BaseT with 32 clients, 50% of the clients are 486/25-based PCs running Windows 95 with Service Pack 1, 50% of the clients are 100Mhz Pentium PCs running Windows NT 3.51 with Service Pack 4, 16MB RAM, 2 XYZ 100BaseT Ethernet hubs, 16 clients per segment, 50% of the clients have ABC 100BaseT network cards and 50% of the clients have GHI 100BaseT network cards, Microsoft Client for Microsoft Networks, Microsoft TCP/IP, Microsoft Windows Sockets Version 1.1, xxxxxx.SYS LAN driver);

D. Identify the controller operating system version, network software and version, and network card (e.g., Windows NT, Microsoft Client for Microsoft Networks, Microsoft TCP/IP, Microsoft Windows Sockets Version 1.1, xxxxxx.SYS LAN driver, ABC 100BaseT network card);

E. Identify any other special conditions used to achieve the result;

F. State that all products used in the test were shipping versions available to the general public;

G. State that the test was performed without independent verification by Ziff-Davis and that Ziff-Davis makes no representations or warranties as to the results of the test; and

H. Follow proper trademark usage and acknowledge Ziff-Davis' trademark rights (e.g., "[ ] achieved a WebBench(TM) overall score of X requests per second and a throughput score of X bytes per second. WebBench(TM) is a trademark of Ziff-Davis Inc. in the U.S. and other countries.").

This Agreement and your rights hereunder shall automatically terminate if you fail to comply with any provision of this Agreement. Upon such termination, you shall cease all use of the Software, cease the transfer of any copies of the Software and cease the publication of benchmark test results obtained by you from use of the Software. Further, you shall delete the Software and destroy all tangible copies of the Software and other materials related to the Software in your possession or under your control, or, if downloaded or preloaded on your hard drive or if provided as part of a collection, you shall cease use of and destroy any and all copies of the Software in your possession or under your control.

2. Additional Restrictions

A. You shall not (and shall not permit other persons or entities to) rent, lease, sell, sublicense, assign, or otherwise transfer the Software or this Agreement. Any attempt to do so shall be void and of no effect.

B. You shall not (and shall not permit other persons or entities to) reverse engineer, decompile, disassemble, merge, modify, include in other software or translate the Software, or use the Software for any commercial purposes, except for the publication of test results, as provided above.

C. You shall not (and shall not permit other persons or entities to) remove or obscure Ziff-Davis' copyright, trademark or other proprietary notices or legends from any of the materials contained in this package or downloaded.

D. You acknowledge that the Software contains Ziff-Davis' trade secret information and you shall not disclose or disseminate such information other than as provided herein.

3. Disclaimer of Warranty; Limitation of Liability

THE SOFTWARE AND THE MEDIA ARE PROVIDED "AS IS" WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING, WITHOUT LIMITATION, ANY WARRANTY OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE.

THE ENTIRE RISK AS TO THE RESULTS AND PERFORMANCE OF THE SOFTWARE AND THE MEDIA IS ASSUMED BY YOU, AND ZIFF-DAVIS AND ITS AUTHORIZED DISTRIBUTORS ASSUME NO RESPONSIBILITY FOR THE ACCURACY OR APPLICATION OF OR ERRORS OR OMISSIONS IN THE SOFTWARE OR THE MEDIA. IN NO EVENT SHALL ZIFF-DAVIS OR ITS AUTHORIZED DISTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, SPECIAL, INCIDENTAL OR CONSEQUENTIAL DAMAGES ARISING OUT OF THE USE OR INABILITY TO USE THE SOFTWARE OR THE MEDIA, EVEN IF ZIFF-DAVIS OR ITS AUTHORIZED DISTRIBUTORS HAVE BEEN ADVISED OF THE LIKELIHOOD OF SUCH DAMAGES OCCURRING. ZIFF-DAVIS AND ITS AUTHORIZED DISTRIBUTORS SHALL NOT BE LIABLE FOR ANY LOSS, DAMAGES OR COSTS, ARISING OUT OF, BUT NOT LIMITED TO, LOST PROFITS OR REVENUE, LOSS OF USE OF THE SOFTWARE OR THE MEDIA, LOSS OF DATA OR EQUIPMENT, THE COSTS OF RECOVERING SOFTWARE, THE MEDIA, DATA OR EQUIPMENT, THE COST OF SUBSTITUTE SOFTWARE OR THE MEDIA, DATA OR EQUIPMENT OR CLAIMS BY THIRD PARTIES, OR OTHER SIMILAR COSTS.

SOME STATES DO NOT ALLOW EXCLUSION OR LIMITATION OF IMPLIED WARRANTIES OR LIMITATION OF LIABILITY FOR INCIDENTAL OR CONSEQUENTIAL DAMAGES; SO THE ABOVE LIMITATIONS OR EXCLUSIONS MAY NOT APPLY TO YOU.

4. U.S. Government Restricted Rights

The Software is licensed subject to RESTRICTED RIGHTS. Use, duplication or disclosure by the Government or any person or entity acting on its behalf is subject to restrictions as set forth in subdivision (c)(1)(ii) of the Rights in Technical Data and Computer Software Clause at DFARS (48 CFR 252.227-7013) for DoD contracts, in paragraphs (c)(1) and (2) of the Commercial Computer Software-Restricted Rights clause in the FAR (48 FR 52.227-19) for civilian agencies, or in the case of NASA, in Clause 18-52.227-86(d) of the NASA Supplement to the FAR, or in other comparable agency clauses. The contractor/manufacturer is Ziff-Davis Benchmark Operation, 1001 Aviation Parkway, Suite 400, Morrisville, North Carolina 27560.

5. General Provisions

Nothing in this Agreement constitutes a waiver of Ziff-Davis' rights under U.S. copyright laws or any other Federal, state, local or foreign law. You are responsible for installation, management, and operation of the Software. However, if you have questions or problems regarding the Software or Media, you can write to Ziff-Davis Benchmark Operation, 1001 Aviation Parkway, Suite 400, Morrisville, North Carolina 27560 Attn: Distribution Coordinator. This Agreement constitutes the entire agreement between the parties with respect to the Software and the Media and supersedes all prior or contemporaneous understandings or agreements, written or oral, regarding such subject matter. This Agreement shall be governed by and construed in accordance with the laws of the State of New York, applicable to agreements made and performed in New York. If any provision of this Agreement shall be held by a court of competent jurisdiction to be illegal, invalid or unenforceable, the remaining provisions shall remain in full force and effect and the unenforceable provision shall be reformed without further action by the parties and only to the extent necessary to make such provision valid and enforceable and to achieve the like economic intent and effect of such provision.

GETTING THE FILES YOU NEED

The \WB11\ directory contains the following subdirectories:

\CLIENT
\CONTROLR

The CLIENT subdirectory contains all the files you need to install WebBench on each client. To install your client files, you'll need to run the Windows-based SETUP.EXE program on each client.

The CONTROLR subdirectory contains all the files you need to install on the controller. To install your controller files, you'll need to run the Windows-based SETUP.EXE program on the controller.

You can also download WebBench from ZDNet(TM)/World Wide Web Edition or ZDNet/CompuServe® Edition. You'll need to download two files. The self-extracting file WBCONTLR.EXE contains the controller SETUP.EXE program and the self-extracting file WBCLIENT.EXE contains the client SETUP.EXE program. You'll need to expand these files to get the setup programs.

INSTALLING WEBBENCH(TM) VERSION 1.1

To run the WebBench test suites, you must have a Web server, a PC running Microsoft® Windows NT® 3.51 or 4.0 with an x86-compatible processor (this is the controller), at least one client running either Windows® 95 or Windows NT 3.51 or 4.0, and a network that allows these machines to communicate. WebBench provides both static test suites and dynamic test suites. You can run the static test suites against any server. The dynamic test suites are platform dependent.

For the dynamic test suites, WebBench provides a CGI application for the following server platforms: Apple’s Mac® OS 7.53, Digital(TM) UNIX® with Alpha(TM) processors, IBM’s OS/2® Warp Server, Linux with x86 processors, Microsoft’s Windows NT® 3.51/4.0 with x86 processors, Silicon Graphics’ IRIX(TM), and Sun’s Solaris(TM) 2.5 on SPARC®. In addition, we re-wrote the CGI application as a Windows NT Microsoft Internet Server API dynamically linked library (ISAPI.DLL), a Windows NT Netscape Server API dynamically loadable library (NSAPI.DLL), an IntranetWare Local-CGI Netware Loadable Module (L-CGI NLM), and a Solaris on SPARC, Digital Alpha, and IRIX NSAPI shared object (.so).

We recommend that you read the installation instructions in The WebBench(TM) Tester's Handbook before you install WebBench. The installation instructions contain information on WebBench's minimum hardware and software requirements and how to set up your machines for testing. The following is a quick overview of the WebBench installation process.

You install WebBench by running the controller SETUP.EXE program on the controller and the client SETUP.EXE program on each client. As part of the client installation, WebBench asks you for a unique ID number for each client. We recommend you number the clients sequentially, starting at 1. (WebBench's standard test suites use client IDs 1 through 60.)

The SETUP.EXE program creates an installation directory on each PC and places the appropriate files in it. To complete the client installation, you'll need to edit each client's HOSTS file to include the IP address for each server you want to test against and the IP address for the controller. While you can use any name you choose for the server (the standard WebBench test suites use the default name server), you must use the name controller for the Windows NT workstation you're using as the controller.

After you install the controller and client programs, you'll need to place the WebBench test files on the server. These files are in compressed format in the WORKLOAD directory in the WebBench installation directory on the controller.

If you plan to run the dynamic test suites, you’ll need to be sure to get the correct compressed file for your server operating system. The following list shows you which file to get for which operating system.

Move that file to your server and expand it. You'll then have the directory WB10TREE and the WebBench dynamic executable(s). Move WB10TREE to the HTML document root on the Web server (this is where the Web server looks for its HTML files). If you're running WebBench on one of the server platforms that it supports for its dynamic tests, you'll need to move the dynamic executable(s) to your Web server's CGI-BIN directory. This is the directory where the Web server looks for its CGI and other dynamic scripts. If this directory has a different name on your server, you'll need to create the alias CGI-BIN for that directory. Make sure CGI-BIN and the directory it is in have execute permission. Depending on which dynamic executable you want to use, you may also have to do some additional setup work. See The WebBench(TM) Tester's Handbook for information on installing the dynamic executables.

NOTE: If your Web server can’t expand one of the above compressed files, you can expand the NT_x86.EXE file on your controller and move the directory containing the test files, WB10TREE, to the correct directory on your server. The test files take up about 3 MB, so you should expand NT_x86.EXE on a network directory from which you can simply move the WB10TREE directory tree to your server. If you need to put WB10TREE on a diskette, you’ll have to compress WB10TREE using the compression tool of your choice. This way you'll be able to run WebBench's static test suites against any Web server platform.

WHERE TO FIND DETAILED INSTALLATION INSTRUCTIONS

We supply on-line copies of The WebBench(TM) Tester's Handbook. On the Ziff-Davis Server Benchmarks CD-ROM, this manual is in the directory \DOCS\WB11. The handbook uses the base name WBHANDBK.* . We supply this manual in three formats: Microsoft Word 7.0 for Windows® (.DOC), Rich Text Format (.RTF), and ASCII format (.TXT). This way, even if you don't have Word for Windows, you should still be able to print a copy of these manuals. (WebBench also places this manual in the \DOCS subdirectory on the controller when you install WebBench.)

If you've downloaded the WebBench controller and client files from ZDNe/World Wide Web Edition or ZDNet/CompuServe Edition, you can also download a copy of this manual in Microsoft Word format. (ZDNet is a Ziff-Davis on-line service.)

In addition, you can start WebBench on the controller and view the information in The WebBench(TM) Tester's Handbook from the on-line help.

WHAT'S NEW ABOUT WEBBENCH 1.1

WebBench 1.1 contains several enhancements over WebBench 1.0. These include:

  • Additional workload files. WebBench 1.1 has expanded its set of dynamic test suites to cover more operating systems and more types of interfaces.
  • The ability to test proxy servers.
  • An improved configuration database that you use for setting up disclosure information about your server and clients. In addition to being easier to use and having simpler server and client disclosure forms, the new database files are compatible with the ServerBench 4.0 database files.

For more details about these features, see the The WebBench(TM) Tester's Handbook.

IMPORTANT WEBBENCH NOTES

The following list provides information you need to know BEFORE you run WebBench.

  1. You must read and agree to the license information at the beginning of this file before you run WebBench. The same information appears on the controller's screen when you first run WebBench and in the front of the WebBench manual. If you do not agree to the licensing information, cease use of the benchmark and delete all copies of WebBench in your possession or under your control. If you received WebBench on a CD-ROM, return the CD-ROM and all accompanying materials (including any documentation) to the Ziff-Davis Benchmark Operation (ZDBOp) at the following address:

    Ziff-Davis Benchmark Operation
    1001 Aviation Parkway, Suite 400
    Morrisville, NC 27560

  2. We've noticed a problem on Windows 95 clients when we run them continuously with multiple threads for at least an hour and a half. At that time the PC begins doing a lot of disk activity that is usually associated with page swaps. If you want to run test mixes using multiple threads on each client, we recommend you use Windows NT clients.

  3. In our testing we've discovered that, if you run WebBench on a Web server that has logging enabled, over time the WebBench scores may go down and the test results may not be repeatable. This drop in performance and repeatability occurs as the size of the log file increases. We recommend that you disable logging on your Web server software before you run WebBench.

  4. Some Web servers may not allow you to create a CGI-BIN alias to the CGI root directory on the Web server (this is the directory where WebBench looks for dynamic executables). In this case, you will need to edit the workload files by hand so that they point to right URL for the dynamic executable. (See Chapter 6 in The WebBench(TM) Tester's Handbook for information on how to modify the workload files.)

  5. You can compare your WebBench 1.1 results with your WebBench 1.0 results for all common test suites except the Windows NT CGI test suites. We changed the Windows NT CGI executable that the test suites ZD_NT_SIMPLE_CGI20_V11.TST and ZD_NT_SIMPLE_CGI20_KEEPALIVE_V11.TST use because of a problem with some compiler libraries. As a result of the change, this executable no longer generates numerous errors when you run it on multiple processor configurations.

  6. The WebBench(TM) Tester's Handbook provides the minimum information you need to install and run WebBench, view your results, and create test suites. If you need additional information, look in the WebBench help file. Because WebBench and ServerBench share many of the same dialog boxes, you can also use the Understanding and Using ServerBench® 4.0 reference manual to get more details on some WebBench tasks. You'll find this manual in the ServerBench documentation directories on the Server Benchmarks CD-ROM(\DOCS\SB40\<ServerBench- platform>). You can also download this manual from the same ZDNet locations where you can download the benchmark programs (see the section "Technical Support" for the addresses to ZDNet/World Wide Web and ZDNet/CompuServe.)

DOCUMENTATION

WebBench 1.1 comes with the following documentation:

README.WRI This file contains the WebBench 1.1 license agreement, information on where to find detailed installation instructions, and important notes about WebBench 1.1. You should read this information before you run WebBench. (This is the file you are reading now.)

WBHANDBK.*** This is The WebBench(TM) Tester's Handbook. This book focuses on the basic steps you need to perform to install WebBench, run its standard test suites, and view your results. We include three formats of this manual in the \DOCS\WB11 directory on the CD-ROM. The .DOC version is in Word for Windows format; the .RTF version is in Rich Text Format; and the .TXT version is a plain ASCII text file.

WEBBENCH.HLP This is WebBench's on-line HELP information, which is accessible from the controller when WebBench is running.

TECHNICAL SUPPORT

If you have problems installing or running this release of WebBench, please contact the Ziff-Davis Benchmark Operation (ZDBOp). You'll find a Problem Report form at the back of the WebBench manual. You can use this form for read

   

Home | Contents | Tech support | WebBench programs | Ordering

Questions about benchmark distribution: (zdbop_distribution@zd.com ). 

 
    Copyright (c) 1997 Ziff-Davis Inc. All Rights Reserved. Reproduction in whole or in part in any form or medium without written express permission of Ziff-Davis Inc. is prohibited. ZDBOp, ZDNet, and WebBench are trademarks of Ziff-Davis Inc.

For magazine subscription savings, risk-free trial issues, newsletters, and more, click here!

    We rate with RSACi!